Groups
Category
In-context learning (ICL) means a model learns from examples provided in the input itself, without updating its parameters.
The kernel (lazy) regime keeps neural network parameters close to their initialization, making training equivalent to kernel regression with a fixed kernel such as the Neural Tangent Kernel (NTK).