Category
Level
Information theory quantifies uncertainty and information using measures like entropy, cross-entropy, KL divergence, and mutual information.