How I Study AI - Learn AI Papers & Lectures the Easy Way

dVoting: Fast Voting for dLLMs

Intermediate

Sicheng Feng, Zigeng Chen et al.Feb 12arXiv

Diffusion Large Language Models (dLLMs) can write many parts of an answer at once, not just left to right like usual chatbots.

#diffusion large language models#remasking#test-time scaling

Residual Context Diffusion Language Models

Intermediate

Yuezhou Hu, Harman Singh et al.Jan 30arXiv

Diffusion language models (dLLMs) generate several tokens at once but usually throw away lots of helpful clues each step—RCD keeps and reuses those clues.

#diffusion language models#residual context diffusion#soft tokens

Diffusion In Diffusion: Reclaiming Global Coherence in Semi-Autoregressive Diffusion

Intermediate

Linrui Ma, Yufei Cui et al.Jan 20arXiv

The paper proposes Diffusion in Diffusion, a draft-then-revise method that brings back global coherence to fast, block-based diffusion language models.

#discrete diffusion#block diffusion#semi-autoregressive

Papers3

dVoting: Fast Voting for dLLMs

Residual Context Diffusion Language Models

Diffusion In Diffusion: Reclaiming Global Coherence in Semi-Autoregressive Diffusion