Concepts5

Groups

In-Context Learning Theory

In-context learning (ICL) means a model learns from examples provided in the input itself, without updating its parameters.

#in-context learning#transformer#attention+12

📚TheoryAdvanced

Reproducing Kernel Hilbert Spaces (RKHS)

An RKHS is a space of functions where evaluating a function at a point equals taking an inner product with a kernel section, which enables the “kernel trick.”

#rkhs

Concepts5

In-Context Learning Theory

Reproducing Kernel Hilbert Spaces (RKHS)

Information Bottleneck

Information Bottleneck Theory

Statistical Learning Theory