Locas: Your Models are Principled Initializers of Locally-Supported Parametric Memories
IntermediateSidi Lu, Zhenwen Liang et al.Feb 4arXiv
Locas is a new kind of add-on memory for language models that learns during use but touches none of the model’s original weights.
#Locas#parametric memory#test-time training