Empty Shelves or Lost Keys? Recall Is the Bottleneck for Parametric Factuality
IntermediateNitay Calderon, Eyal Ben-David et al.Feb 15arXiv
Not all wrong answers from large language models (LLMs) mean they never learned the factโmany times the model knows it but canโt pull it out on demand.
#LLM factuality#encoding vs recall#knowledge profiling