How I Study AI - Learn AI Papers & Lectures the Easy Way

BatCoder: Self-Supervised Bidirectional Code-Documentation Learning via Back-Translation

Intermediate

Jingwen Xu, Yiyang Lu et al.Jan 30arXiv

BatCoder teaches a code model to write both code and its documentation by doing a round trip: from code to docs and back to code.

#back-translation#self-supervised learning#reinforcement learning for code

Stable-DiffCoder: Pushing the Frontier of Code Diffusion Large Language Model

Intermediate

Chenghao Fan, Wen Heng et al.Jan 22arXiv

Stable-DiffCoder is a code-focused diffusion language model that learns to write and edit programs by filling in masked pieces, not just predicting the next token.

#diffusion language model#block diffusion#code generation

DEER: Draft with Diffusion, Verify with Autoregressive Models

Intermediate

Zicong Cheng, Guo-Wei Yang et al.Dec 17arXiv

DEER is a new way to speed up big language models by letting a diffusion model draft many tokens at once and an autoregressive model double-check them.

#DEER#speculative decoding#diffusion LLM

Papers3

BatCoder: Self-Supervised Bidirectional Code-Documentation Learning via Back-Translation

Stable-DiffCoder: Pushing the Frontier of Code Diffusion Large Language Model

DEER: Draft with Diffusion, Verify with Autoregressive Models