📚TheoryAdvanced
Information Bottleneck in Deep Learning
The Information Bottleneck (IB) principle formalizes learning compact representations T that keep only the information about X that is useful for predicting Y.
#information bottleneck#variational information bottleneck#mutual information+11