45 min
What Really Separates Autoregression and Diffusion? A Synthesis and Path Beyond
Machine Learning, Deep Learning and seminar by Jiaxin Shi, Meta
Thursday 14:00 Los Angeles (GMT-7)
Recording available
Berkeley, United States
Recording
Abstract
Masked diffusion provides a common lens for comparing autoregressive and diffusion-based generation. This talk argues that observed differences in parallelism and perceptual quality can follow from training and specification choices rather than a fundamental divide. It then studies adaptive generation orders, insertion-based planning and scalable maximum-likelihood learning beyond fixed or random ordering.
Topics
Masked diffusiondiffusion-based generationparallelismperceptual qualityadaptive generation ordersinsertion-based planningmaximum-likelihood learning