Groups
Category
Rate–distortion theory tells you the minimum number of bits per symbol needed to represent data while keeping average distortion below a target D.
The Information Bottleneck (IB) principle formalizes the tradeoff between compressing an input X and preserving information about a target Y using the objective min_{p(t|x)} I(X;T) - \beta I(T;Y).