Diffusion Model
How most AI image tools work — starting from random noise and removing it step by step, guided by a prompt, until a picture appears.
Reviewed July 10, 2026Stable
When not to use it
- When you need the same output twice. Diffusion is stochastic by design. For deterministic assets, generate once and store the file.
- For text inside images, precise counts, or exact layouts. These are known weak spots; the model is painting what text looks like, not typesetting it.
- Where provenance matters. If you can't say where the training data or the output came from, that's a legal and editorial question before it's a technical one.
Reach for something else instead
- Autoregressive image models and GANs each trade differently on speed, diversity, and control; GANs are still faster at inference for narrow domains.
- Templates and design tools when you need exact, repeatable, brand-correct output — which is most commercial work.
- Stock or commissioned imagery when licensing clarity is worth more than novelty.
Read more on the blog
- How AI generates images: from noise to a pictureType a sentence, get an image that never existed. The technology behind it, diffusion, is one of the most simple ideas in modern AI: teach a model to remove noise, then hand it pure static and let it sculpt. Here's how it actually works, how text steers it, and the 2026 rivalry reshaping the field.
- How AI generates video: from noise to motionText-to-video went from a novelty to convincing minute-long clips with synchronised audio in about two years. The technology behind it extends image generation into time, and the hardest part is not making a frame look good but making a thousand frames hang together. Here is how it works.
- What is generative AI? The complete guideGenerative AI is the technology behind the chatbots, image makers, and video tools of the last few years, and it is usually explained as if each were a separate trick. Underneath, they share one idea: learn the probability distribution of some kind of data, then sample from it to make new examples. This guide explains what generative AI is, how it works, the model families, and where it really falls short.
- What is multimodal AI? One model that sees, reads, and hearsFor years, AI was single-track, one model read text, another saw images, a third heard audio. Multimodal AI collapses those silos into a single model that reasons across all of them at once. Here's how it works, why one shared representation space is the key, and where it still falls short.
A diffusion model learns to reverse noise, step by step, into an image.
Training adds noise to real images in small steps until they're pure static; the model learns to undo each step. To generate, it starts from random noise and runs the learned denoising in reverse, gradually revealing a coherent image. This step-by-step reversal is why diffusion models are slower than GANs but more stable and controllable — the mechanism behind most modern image generators.
Further reading
- Ho, Jain & Abbeel (2020), Denoising Diffusion Probabilistic Models — the paper that made diffusion work.
- Rombach et al. (2022), High-Resolution Image Synthesis with Latent Diffusion Models — Stable Diffusion, and the move to latent space that made it runnable on consumer hardware.
- Song, Meng & Ermon (2020), Denoising Diffusion Implicit Models — fewer steps, and the speed/quality trade-off you actually tune.
Primary sources, listed so you can check the claims on this page rather than take them on trust.
Where people go wrong
- Prompting harder to fix a structural failure. If the model can't do hands or text, more adjectives won't help — inpainting or a different tool will.
- Ignoring the step-count/quality trade-off, then complaining about latency. Fewer steps is often nearly as good and much faster.
- Treating the seed as irrelevant. It's the one lever that makes results reproducible enough to iterate on.
At a glance
FieldGenerative AI
Core ideadenoise from static to image
Trade-offquality vs. number of steps
Key controlssteps, guidance, seed
DifficultyIntermediate
Often compared with
Diffusion vs. GAN — iterative denoising vs. a generator trained against a discriminator.
Where this sits
16 concepts come first. Understanding it opens up 4 more.
8Levelsteps in
16Needs firstconcepts
4Opens up1% of 310
1Areastays here
Computed from the prerequisite graph, not assigned. How this works