Spectral Attention Steering for Prompt Highlighting
BeginnerWeixian Waylon Li, Yuchen Niu et al.Mar 1arXiv
This paper teaches a new way to make a language model pay extra attention to the exact words you highlight in a prompt.
#attention steering#prompt highlighting#key embeddings