Papers2

#pairwise comparison

ArenaRL: Scaling RL for Open-Ended Agents via Tournament-based Relative Ranking

Qiang Zhang, Boli Chen et al.Jan 10arXiv

ArenaRL teaches AI agents by comparing their answers against each other, like a sports tournament, instead of giving each answer a single noisy score.

#ArenaRL#reinforcement learning#relative ranking

Are We on the Right Way to Assessing LLM-as-a-Judge?

Intermediate

Yuanning Feng, Sinan Wang et al.Dec 17arXiv

This paper asks whether we are judging AI answers the right way and introduces Sage, a new way to test AI judges without using human-graded answers.

#LLM-as-a-Judge#Sage evaluation#Intra-Pair Instability