dLLM Notes

About

Notes written while learning

I am Buffett Liu. This site is where I work through diffusion language models (dLLMs) in public: masked diffusion objectives, sampling strategies, the models that scaled them, and the systems work needed to serve them.

The notes follow three tracks. Inside the Model covers how dLLMs are designed, trained, and sampled; Into Production covers how to serve them efficiently; Speculative Drafting uses diffusion ideas to serve AR models faster.

If you have any suggestions, please open an issue.