InformationTheory

A measure of how well one probability distribution encodes events from another.

A measure of uncertainty — highest when all outcomes are equally likely, lowest when one dominates.