Papers2

#language modeling

Diffusion In Diffusion: Reclaiming Global Coherence in Semi-Autoregressive Diffusion

The paper proposes Diffusion in Diffusion, a draft-then-revise method that brings back global coherence to fast, block-based diffusion language models.

#discrete diffusion#block diffusion#semi-autoregressive

Enriching Word Vectors with Subword Information

Intermediate

Piotr Bojanowski, Edouard Grave et al.Jul 15arXiv

This paper teaches computers to understand words by also looking at the smaller pieces inside words, like 'un-', 'play', and '-ing'.

#subword embeddings#character n-grams#skip-gram