Are We on the Right Way to Assessing LLM-as-a-Judge?
IntermediateYuanning Feng, Sinan Wang et al.Dec 17arXiv
This paper asks whether we are judging AI answers the right way and introduces Sage, a new way to test AI judges without using human-graded answers.
#LLM-as-a-Judge#Sage evaluation#Intra-Pair Instability