Cross-Entropy
A measure of how well one probability distribution encodes events from another.
Notes tagged InformationTheory
-
-
Information Entropy
A measure of uncertainty — highest when all outcomes are equally likely, lowest when one dominates.