How I Study AI - Learn AI Papers & Lectures the Easy Way

Adaptive Ability Decomposing for Unlocking Large Reasoning Model Effective Reinforcement Learning

Intermediate

Zhipeng Chen, Xiaobo Qin et al.Jan 31arXiv

This paper teaches a model to make its own helpful hints (sub-questions) and then use those hints to learn better with reinforcement learning that checks answers automatically.

#RLVR#Large Reasoning Models#Sub-question Guidance

Your Group-Relative Advantage Is Biased

Intermediate

Fengkai Yang, Zherui Chen et al.Jan 13arXiv

Group-based reinforcement learning for reasoning (like GRPO) uses the group's average reward as a baseline, but that makes its 'advantage' estimates biased.

#Reinforcement Learning from Verifier Rewards#GRPO#GSPO

OPV: Outcome-based Process Verifier for Efficient Long Chain-of-Thought Verification

Intermediate

Zijian Wu, Lingkai Kong et al.Dec 11arXiv

Big AI models often write very long step-by-step solutions, but usual checkers either only check the final answer or get lost in the long steps.

#Outcome-based Process Verifier#Chain-of-Thought#Process Verification

Papers3

Adaptive Ability Decomposing for Unlocking Large Reasoning Model Effective Reinforcement Learning

Your Group-Relative Advantage Is Biased

OPV: Outcome-based Process Verifier for Efficient Long Chain-of-Thought Verification