Every design choice in a diffusion language model
An interactive map of the parts of a diffusion language model, and the paper recipes built from them.
Research & ideas
Blog
Notes on research, experiments, and updates.
Compression as evaluation
Can we use compression to evaluate generated text using the reference data itself as the standard, rather than importing a definition of good language from a pretrained model or a hand-designed feature set?
Generative Frontiers: Why Evaluation Matters for Diffusion Language Models
Discussion on Evaluation Methodology for dLLMs
Diffusion Language Models: Some Nice Visualizations
Some (hopefully) Nice visualizations for understanding diffusion LMs