Papers5

#HumanEval

TAROT: Test-driven and Capability-adaptive Curriculum Reinforcement Fine-tuning for Code Generation with Large Language Models

Chansung Park, Juyong Jiang et al.Feb 17arXiv

TAROT teaches code-writing AI the way good teachers teach kids: start at the right level and raise the bar at the right time.

#TAROT#curriculum learning#reinforcement fine-tuning

Self-Rewarding Sequential Monte Carlo for Masked Diffusion Language Models

Intermediate

Ziwei Luo, Ziqi Jin et al.Feb 2arXiv

The paper introduces a new way to sample text from masked diffusion language models that is smarter and less greedy.

#masked diffusion language models#sequential Monte Carlo#self-rewarding sampling

BatCoder: Self-Supervised Bidirectional Code-Documentation Learning via Back-Translation

Intermediate

Jingwen Xu, Yiyang Lu et al.Jan 30arXiv

BatCoder teaches a code model to write both code and its documentation by doing a round trip: from code to docs and back to code.

#back-translation#self-supervised learning#reinforcement learning for code

Stable-DiffCoder: Pushing the Frontier of Code Diffusion Large Language Model

Intermediate

Chenghao Fan, Wen Heng et al.Jan 22arXiv

Stable-DiffCoder is a code-focused diffusion language model that learns to write and edit programs by filling in masked pieces, not just predicting the next token.

#diffusion language model#block diffusion#code generation

DEER: Draft with Diffusion, Verify with Autoregressive Models

Intermediate

Zicong Cheng, Guo-Wei Yang et al.Dec 17arXiv

DEER is a new way to speed up big language models by letting a diffusion model draft many tokens at once and an autoregressive model double-check them.

#DEER#speculative decoding#diffusion LLM