The Pensieve Paradigm: Stateful Language Models Mastering Their Own Context
IntermediateXiaoyuan Liu, Tian Liang et al.Feb 12arXiv
This paper gives language models a 'wand' to manage their own memory, instead of relying on humans to stuff the prompt for them.
#Stateful language models#Pensieve paradigm#Context pruning