Shannon entropy
Shannon entropy is essentially the breath of possible outcomes for a random variable (Shannon1948).
If some single outcome occurs with a probability of 1, Shannon entropy is minimized (=0).
Appendix
Related
Compressibility & Lempel-Ziv complexity
production entropy