Diffusion models

Antonio Ocello tests the idea that heavy-tailed noise improves diffusion and flow-based generative models by matching heavy-tailed data and encouraging diverse samples. Replacing Gaussian noise also changes the estimation task. A combined theoretical and experimental study derives sampling-error bounds for representative heavy- and light-tailed diffusion models, finding that heavy-tailed noise makes statistical estimation harder and produces less favourable bounds. Experiments with synthetic and real data recover the predicted trade-off. The results question whether heavy-tailed initialization

Google DeepMind research director Brendan O'Donoghue examines discrete diffusion as an alternative to autoregressive text generation. He discusses sample diversity, reinforcement learning, latency and potential on-device or robotics applications. The episode also addresses the costs of serving diffusion models, hardware trade-offs between computation and memory bandwidth, and practical limits on progress toward more capable AI. Hosted by Ravid Shwartz Ziv and Allen Roush. Watch the full conversation on the publisher’s YouTube channel.

Stefano Ermon discusses adapting diffusion models to language and code generation. Topics include discrete token spaces, parallel token generation, Mercury 2, and trade-offs with autoregressive models. The conversation examines training, serving and post-training challenges, controllable generation and possible directions for multimodal diffusion systems.

Hung Bui examines efficient diffusion models for image generation and editing on devices. The discussion covers SwiftBrush and SwiftEdit, distillation from iterative teachers into single-step students, and a coach network that aligns denoising behaviour. It also considers personalised agents and reasoning under fixed compute budgets.

…While latent variable models can successfully extract low-dimensional embeddings from such recordings, using them to generate realistic spiking data, especially in a behavior-dependent manner, still poses a challenge. Here, we present Latent Diffusion for Neural Spiking data (LDNS), a diffusion-based generative model with a low-dimensional latent space: LDNS employs an autoencoder with structured state-space (S4) layers to proj

…While latent variable models can successfully extract low-dimensional embeddings from such recordings, using them to generate realistic spiking data, especially in a behavior-dependent manner, still poses a challenge. Here, we present Latent Diffusion for Neural Spiking data (LDNS), a diffusion-based generative model with a low-dimensional latent space: LDNS employs an autoencoder with structured state-space (S4) layers to pro

…first part of my talk, I will focus on diffusion models as generative mo

…first part of my talk, I will focus on diffusion models as generative mo

…recent success in machine learning of “diffusion models” as a means of learning and usin

…thickness, is avascular, and relies on diffusion of oxygen from the choroidal circulation, whose properties are very different, as well as the retinal circulation. By fitting diffusion models to oxygen measurements made with oxygen microelectrodes, it is possible to understand the relative roles

…evidence, a strategy formalized by diffusion models which is supported by decades behavioral and neural findings. By contrast, it is unknown whether this strategy is also used during decision-making when the underlying sensory evidence is expected to change. Here, we trained monkeys to identify the dominant color of a dynamically refreshed checkerboard pattern that doesn't become informative until after a variable delay. Animals' behavioral responses were briefly suppressed after an a