How I Study AI - Learn AI Papers & Lectures the Easy Way

Test-Time Training with KV Binding Is Secretly Linear Attention

Intermediate

Junchen Liu, Sven Elflein et al.Feb 24arXiv

The paper shows that Test-Time Training (TTT) with key–value (KV) binding is not really memorizing like a notebook; it is acting like a learned linear attention layer.

#Test-Time Training#KV Binding#Linear Attention

Reinforcement Learning via Self-Distillation

Intermediate

Jonas Hübotter, Frederike Lübeck et al.Jan 28arXiv

The paper teaches large language models to learn from detailed feedback (like error messages) instead of only a simple pass/fail score.

#Self-Distillation#Reinforcement Learning with Rich Feedback#SDPO

End-to-End Test-Time Training for Long Context

Intermediate

Arnuv Tandon, Karan Dalal et al.Dec 29arXiv

This paper shows how a language model can keep learning while you use it, so it handles very long inputs without slowing down.

#Test-Time Training#Meta-learning#Long-context language modeling

Papers3

Test-Time Training with KV Binding Is Secretly Linear Attention

Reinforcement Learning via Self-Distillation

End-to-End Test-Time Training for Long Context