Diffusion LLM
also: dLLM · text diffusion
A language model that generates text by iteratively denoising all tokens in parallel, instead of one at a time left to right.
A diffusion LLM starts from a fully masked or noised sequence and refines every position over several denoising steps, so tokens are produced in parallel rather than strictly left to right. That trades the autoregressive one-token-at-a-time bottleneck for a fixed number of parallel passes, and lets earlier tokens be revised as later context resolves.