Block Diffusion
A hybrid that runs autoregressively across blocks of tokens but uses diffusion to fill in each block.
Block diffusion splits a sequence into blocks, generating blocks left to right (autoregressive) while denoising all tokens within a block in parallel (diffusion). It aims to keep the quality and KV-cache friendliness of autoregression while recovering some of diffusion’s parallel speed inside each block.