Research

All papers

2025

1. Mercury: Ultra-Fast Language Models Based on Diffusion
   Samar Khanna, Siddhant Kharbanda, Shufan Li, Harshit Varma, Eric Wang, Sawyer Birnbaum, Ziyang Luo, Yanis Miraoui, Akash Palrecha, Stefano Ermon, Aditya Grover
   June 17, 2025

2. LaViDa: A Large Diffusion Language Model for Multimodal Understanding
   Shufan Li, Konstantinos Kallidromitis, Hritik Bansal, Akash Gokul, Yusuke Kato, Kazuki Kozuka, Jason Kuen, Zhe Lin, Kai-Wei Chang, Aditya Grover
   May 22, 2025

3. d1: Scaling Reasoning in Diffusion Large Language Models via Reinforcement Learning
   Siyan Zhao, Devaansh Gupta, Qinqing Zheng, Aditya Grover
   April 16, 2025

4. Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Models
   Marianne Arriola, Aaron Gokaslan, Justin T. Chiu, Zhihan Yang, Zhixuan Qi, Jiaqi Han, Subham Sekhar Sahoo, Volodymyr Kuleshov
   March 12, 2025

5. Remasking Discrete Diffusion Models with Inference-Time Scaling
   Guanghan Wang, Yair Schiff, Subham Sekhar Sahoo, Volodymyr Kuleshov
   March 1, 2025

2024

1. Simple Guidance Mechanisms for Discrete Diffusion Models
   Yair Schiff, Subham Sekhar Sahoo, Guanghan Wang, Hao Phung, Alexander Rush, Volodymyr Kuleshov
   December 13, 2024

2. Simple and Effective Masked Diffusion Language Models
   Subham Sekhar Sahoo, Marianne Arriola, Yair Schiff, Aaron Gokaslan, Edgar Marroquin, Justin T Chiu, Alexander Rush, Volodymyr Kuleshov
   November 10, 2024

2023

1. Discrete Diffusion Modeling by Estimating the Ratios of the Data Distribution
   Aaron Lou, Chenlin Meng, Stefano Ermon
   October 25, 2023

2020

1. Score-Based Generative Modeling through Stochastic Differential Equations
   Yang Song, Jascha Sohl-Dickstein, Diederik P. Kingma, Abhishek Kumar, Stefano Ermon, Ben Poole
   November 26, 2020

2019

1. Generative Modeling by Estimating Gradients of the Data Distribution
   Yang Song, Stefano Ermon
   July 12, 2019

The future of LLMs is here.