The Race to Production-Grade Diffusion LLMs

Stefano Ermon discusses adapting diffusion models to language and code generation. Topics include discrete token spaces, parallel token generation, Mercury 2, and trade-offs with autoregressive models. The conversation examines training, serving and post-training challenges, controllable generation and possible directions for multimodal diffusion systems.