KV-Embedding: Training-free Text Embedding via Internal KV Re-routing in Decoder-only LLMs
IntermediateYixuan Tang, Yi YangJan 3arXiv
This paper shows how to get strong text embeddings from decoder-only language models without any training.
#text embeddings#decoder-only LLMs#causal attention