Shannon Entropy

Shannon entropy $S$ is the expectation of information content $I(X)=-\log \left(p\right)$¹,

\begin{equation} H(p) = \mathbb E_{p}\left[ -\log \left(p\right) \right]. \end{equation}