Concepts2
📚TheoryAdvanced
Representation Learning Theory
Representation learning aims to automatically discover features that make downstream tasks easy, often without human-provided labels.
#representation learning#contrastive learning#infonce+12
📚TheoryAdvanced
Information Bottleneck Theory
Information Bottleneck (IB) studies how to compress an input X into a representation Z that still preserves what is needed to predict Y.
#information bottleneck#mutual information#variational information bottleneck+12