Concepts4
📚TheoryIntermediate
ELBO (Evidence Lower Bound)
The Evidence Lower Bound (ELBO) is a tractable lower bound on the log evidence log p(x) that enables learning and inference in latent variable models like VAEs.
#elbo#variational inference#vae+12
📚TheoryAdvanced
Information Bottleneck Theory
Information Bottleneck (IB) studies how to compress an input X into a representation Z that still preserves what is needed to predict Y.
#information bottleneck#mutual information#variational information bottleneck+12
📚TheoryAdvanced
Statistical Learning Theory
Statistical learning theory explains why a model that fits training data can still predict well on unseen data by relating true risk to empirical risk plus a complexity term.
#statistical learning theory#empirical risk minimization#structural risk minimization+11
📚TheoryIntermediate
Bias-Variance Tradeoff
The bias–variance tradeoff explains how prediction error splits into bias squared, variance, and irreducible noise for squared loss.
#bias variance tradeoff#mse decomposition#polynomial regression+12