How I Study AI - Learn AI Papers & Lectures the Easy Way

Residual Context Diffusion Language Models

Intermediate

Yuezhou Hu, Harman Singh et al.Jan 30arXiv

Diffusion language models (dLLMs) generate several tokens at once but usually throw away lots of helpful clues each step—RCD keeps and reuses those clues.

#diffusion language models#residual context diffusion#soft tokens

Papers1

Residual Context Diffusion Language Models