DDPM,
explained.

Rung 2's difficulty is that both halves of the game are learned, so nothing is stable. This rung's change is to make one direction fixed, simple and known in advance: define a process that takes an image and adds a little Gaussian noise, over and over, for many steps, until nothing is left but noise. That direction involves no learning at all — it is a schedule someone wrote down.

All the model has to learn is to undo one step of it. And because each forward step is a small Gaussian perturbation, the corresponding reverse step is also approximately Gaussian, which makes it something a network can be asked to predict. Generation is then: start from pure noise, apply the learned reverse step many times, arrive at an image.

The training objective is where this becomes remarkable. After simplification, what the network is asked to do is: given a noisy image and how noisy it is, predict the noise that was added — and the loss is a plain squared error on that prediction. Generative modelling has become regression. There is no adversary, so no saddle point and no instability; the loss is a number that decreases and means something; and because every training example is a real image with noise on it, there is no mechanism for mode collapse — the model never gets to choose which parts of the distribution to cover. Stated against rung 2, that is the whole argument, and it is why this family won.

Imagine dropping ink into water. It disperses until the glass is a uniform haze — an easy, predictable process to run forward. Now imagine running it backward: reassembling that haze into the original drop. Impossible to do exactly, but if you learned, at every tiny moment, how to nudge the haze one step back toward order, you could reverse the whole thing.

That's diffusion. The forward direction gradually destroys an image into noise — trivial. The reverse direction rebuilds an image from noise — hard, and exactly what we train a network to do. Generate by starting from pure noise and running the learned reverse steps until a picture appears.

The forward process is a fixed Markov chain with no learnable parameters. Over T steps (the paper uses T = 1000), it repeatedly adds a little Gaussian noise. A noise schedule β₁ … β_T — small numbers that grow over time — sets how much noise each step injects:

In words: each step shrinks the current image slightly and sprinkles in fresh noise. Start with a clean image x₀; after enough steps you reach x_T, which is indistinguishable from pure Gaussian noise. This process is a given — its only purpose is to define the corruption the network must learn to undo.

Adding noise a thousand times to make one training example would be painfully slow. A neat property of Gaussians rescues it: you can jump straight to any timestep in one shot. Define α_t = 1−β_t and ᾱ_t = α₁·α₂·…·α_t, and then

So to make a training example at noise level t, you take a clean image, pick a random t, sample one blob of noise ε, and combine them by the formula above — no thousand-step loop needed. This closed form is what makes DDPM training efficient, and it's the key to the objective coming up.

Reversing the chain means going from x_t to a slightly cleaner x_{t-1}. The true reverse step is intractable, but if each forward step adds only a little noise, each reverse step is well-approximated by a Gaussian too — so we train a network to predict its mean.

That network is a U-Net: an encoder-decoder with skip connections, well suited to images, that also takes the timestep t as input so it knows how noisy things currently are. Apply it repeatedly — x_T → x_{T-1} → … → x₀ — and noise becomes an image. All the model's intelligence lives in this one denoising network.

Earlier diffusion work derived a complicated variational bound and tried to predict full distributions — fiddly and unstable. DDPM's decisive move was to reparameterize the problem. Since x_t = √(ᾱ_t)x₀ + √(1−ᾱ_t)ε, knowing the noise ε is equivalent to knowing the clean image. So just predict ε. The training loss collapses to plain mean-squared error:

The recipe is almost embarrassingly simple: take a clean image, add a known amount of noise, and ask the network to guess the noise you added. Penalize the squared error. That's it. This "simple objective" trained far more stably than the full variational bound and produced dramatically better samples — the entire reason diffusion suddenly worked.

The paper's exact recipe: T = 1000 steps, β rising linearly from 0.0001 to 0.02. Everything interesting lives in the cumulative product ᾱ_t = Π(1−β_s) — the fraction of original signal surviving at step t. Compute it:

Two things to notice. The destruction is front-loaded gently — after 100 of 1000 steps, 95% of the signal amplitude survives; the schedule spends most of its budget in the middle. And at t = 1000 the signal fraction is 0.6% — which is why sampling can start from pure random noise: the endpoint of the forward process genuinely is one.

The reparameterization the whole paper turns on is one line of algebra on the shortcut formula. If you know the noise, you know the image:

Training teaches a network to estimate ε; the identity above converts that estimate back into an image, one denoising step at a time. Generative modeling became regression on noise.

The cost is stated plainly and it is severe: sampling requires many sequential network evaluations — on the order of a thousand in this paper — where a GAN generates in one. Diffusion traded a training problem for a sampling problem, and at publication that made it orders of magnitude slower to generate with. Rungs 5 and 7 are both attacks on this one sentence.

The objective is also acknowledged to be a reweighted version of the proper variational bound rather than the bound itself — the simplification that makes it a clean regression drops terms, and it is justified because it works better, not because it is exact. An honest and consequential piece of empirical pragmatism.

How it held up: it displaced rung 2 as the default for image generation within about two years, and the reasons are the ones above — stable training and full distribution coverage beat one-shot sampling speed, because speed turned out to be fixable and instability did not. Everything from rung 5 to rung 8 is a refinement of this rung, which makes it the most load-bearing paper on the ladder.

To generate, start from pure noise x_T ~ 𝒩(0, I). At each step, run the network to predict the noise, subtract off a scaled portion to get a cleaner estimate, add a touch of fresh noise for stochasticity, and repeat down to x₀. After all T steps you have a fresh image the model has effectively imagined from static.

DDPM produced image quality competitive with the best GANs of the time — without the instability or mode collapse — establishing diffusion as a serious, and soon dominant, family of generative models.

The obvious cost is speed. Generating one image means running the network hundreds or a thousand times — orders of magnitude slower than a GAN's single pass. DDPM also operates directly in pixel space, so high-resolution generation is very expensive in both compute and memory.

Both limits drove the follow-up work. DDIM and other fast samplers cut the step count dramatically; latent diffusion moved the whole process into a compressed space to slash the per-step cost. DDPM is the sturdy foundation those improvements were built on, not the final, efficient product.

DDPM is the paper that made diffusion work, and it launched the generation era we're living in. Every major image and video generator — DALL·E 2, Imagen, Midjourney, Stable Diffusion — descends from the forward/reverse framework and the noise-prediction objective defined here. When a model "denoises" its way to a picture, it's running DDPM's idea.

Its deeper lesson is about the power of the right reframing: a hard generative problem became a simple supervised one by choosing to predict noise. That move dethroned GANs as the default for high-fidelity generation and reoriented the whole field around iterative denoising.

Answer each one out loud before you open it. Recalling an answer is what makes it stick; recognising one you have just read is not. Your score is kept on this device.

Ten papers from the first latent-variable generator to video and real-time 3D. The diffusion half is strictly cumulative — each rung removes a cost the last one paid.

1. 1VAE2014
2. 2GANs2014
3. 3VQ-VAE2017
4. 4DDPM2020
5. 5DDIM2021
6. 6Classifier-Free Guidance2021
7. 7Latent Diffusion2022
8. 8Sora2024
9. 9NeRF2020
10. 103D Gaussian Splatting2023

All 110 papers, in 19 ladders →