How I Study AI - Learn AI Papers & Lectures the Easy Way

EvoCUA: Evolving Computer Use Agents via Learning from Scalable Synthetic Experience

Intermediate

Taofeng Xue, Chong Peng et al.Jan 22arXiv

Before this work, computer-using AIs mostly copied old examples and struggled with long step-by-step tasks on real computers.

#computer use agent#verifiable synthesis#validator

Robust Tool Use via Fission-GRPO: Learning to Recover from Execution Errors

Beginner

Zhiwei Zhang, Fei Zhao et al.Jan 22arXiv

Small AI models often stumble when a tool call fails and then get stuck repeating bad calls instead of fixing the mistake.

#FISSION-GRPO#error recovery#tool use

Diversity or Precision? A Deep Dive into Next Token Prediction

Intermediate

Haoyuan Wu, Hai Wang et al.Dec 28arXiv

The paper shows that teaching a language model with a special “reward-shaped” next-token objective can make later reinforcement learning (RL) work much better.

#next-token prediction#cross-entropy as policy gradient#reward shaping

Papers3

EvoCUA: Evolving Computer Use Agents via Learning from Scalable Synthetic Experience

Robust Tool Use via Fission-GRPO: Learning to Recover from Execution Errors

Diversity or Precision? A Deep Dive into Next Token Prediction