On the Role of Discreteness in Diffusion LLMs
IntermediateZiqi Jin, Bin Wang et al.Dec 27arXiv
The paper asks what a truly good diffusion-based language model should look like and lists five must-have properties.
#diffusion language models#smooth corruption#discrete tokens