This paper shows that when AI models grade university-level math proofs, they often disagree with human experts in systematic ways.
Deep search agents can plan and browse the web in many steps, but they often fail because they don’t notice when their own thinking drifts off-track.