Learning Unmasking Policies for Diffusion Language Models
IntermediateMetod Jazbec, Theo X. Olausson et al.Dec 9arXiv
Diffusion language models write by gradually unmasking hidden words, so deciding which blanks to reveal next is a big deal for both speed and accuracy.
#diffusion language models#masked diffusion#unmasking policy