Concepts2
📚TheoryAdvanced
Deep Learning Generalization Theory
Deep learning generalization theory tries to explain why overparameterized networks can fit (interpolate) training data yet still perform well on new data.
#generalization#implicit regularization#minimum norm+12
📚TheoryIntermediate
Bias-Variance Tradeoff
The bias–variance tradeoff explains how prediction error splits into bias squared, variance, and irreducible noise for squared loss.
#bias variance tradeoff#mse decomposition#polynomial regression+12