Groups
Category
The Maximum Entropy Principle picks the probability distribution with the greatest uncertainty (entropy) that still satisfies the facts you know (constraints).
Rate–distortion theory tells you the minimum number of bits per symbol needed to represent data while keeping average distortion below a target D.