Cross-Entropy
A measure of how well one probability distribution encodes events from another.
A measure of how well one probability distribution encodes events from another.
A measure of uncertainty — highest when all outcomes are equally likely, lowest when one dominates.