Concepts2
📚TheoryAdvanced
Neural Tangent Kernel (NTK) Theory
The Neural Tangent Kernel (NTK) connects very wide neural networks to classical kernel methods, letting us study training as if it were kernel regression.
#neural tangent kernel#ntk#infinite width+12
📚TheoryAdvanced
Deep Learning Generalization Theory
Deep learning generalization theory tries to explain why overparameterized networks can fit (interpolate) training data yet still perform well on new data.
#generalization#implicit regularization#minimum norm+12