Residual Context Diffusion Language Models
IntermediateYuezhou Hu, Harman Singh et al.Jan 30arXiv
Diffusion language models (dLLMs) generate several tokens at once but usually throw away lots of helpful clues each step—RCD keeps and reuses those clues.
#diffusion language models#residual context diffusion#soft tokens