Papers2

#Sequence Modeling

Test-Time Training with KV Binding Is Secretly Linear Attention

Junchen Liu, Sven Elflein et al.Feb 24arXiv

The paper shows that Test-Time Training (TTT) with key–value (KV) binding is not really memorizing like a notebook; it is acting like a learned linear attention layer.

#Test-Time Training#KV Binding#Linear Attention

Not triaged yet

Recurrent Neural Networks (RNNs): A gentle Introduction and Overview

Beginner

Robin M. SchmidtNov 23arXiv

Recurrent Neural Networks (RNNs) are special neural networks that learn from sequences, like sentences or time series, by remembering what came before.

#Recurrent Neural Network#Backpropagation Through Time#Truncated BPTT

Not triaged yet