Groups
Minimum Description Length (MDL) picks the model that compresses the data best by minimizing L(M) + L(D|M).
The Information Bottleneck (IB) principle formalizes the tradeoff between compressing an input X and preserving information about a target Y using the objective min_{p(t|x)} I(X;T) - \beta I(T;Y).