Deep Learning podcasts

Andrew Dai joins The Information Bottleneck to discuss language-model pre-training, next-token prediction, training-data quality and visual reasoning. The conversation examines counting and image understanding, world models and JEPA. Hosted by Ravid Shwartz-Ziv and Allen Roush.

Alex Smola discusses the development of voice agents, audiovisual systems and AI avatars. Topics include audio tokenization, inference cost, conversational latency, visual context and how artificial systems might learn from interaction while responding appropriately to human emotion.

Hosted by Sam Charrington

Sara Hooker of Adaptation Lab explores AI systems that change with their users, tasks and environments. The discussion connects continual learning, efficient adaptation and automated science with the difficulty of evaluating tasks that lack easily checked answers. It also covers interfaces, distillation, open models, safety and regulation, multilingual tokenization, and possible successors to current Transformer systems. Hosted by Ravid Shwartz Ziv and Allen Roush. Watch the full conversation on the publisher’s YouTube channel.

Hosted by Ravid Shwartz Ziv, Allen Roush

Microsoft researcher Alexia Jolicoeur-Martineau explains the Tiny Recursive Model and the reasoning behind her work on small networks that repeatedly refine an internal state and proposed answer. The conversation examines truncated gradients, puzzle-solving benchmarks and the differences from autoregressive language generation. It also considers molecular modelling, limits of data scaling and which research directions she would prioritize. Hosted by Ravid Shwartz Ziv and Allen Roush. Watch the full conversation on the publisher’s YouTube channel.

Hosted by Ravid Shwartz Ziv, Allen Roush

Rohan Anil of Core Automation discusses the relationship between pretraining, reinforcement learning and learning after deployment. Drawing on his optimization work at Google and Anthropic, he examines why additional post-training, distillation and longer contexts may not solve continual learning. Other topics include second-order optimizers, distributed training, low-level coding agents and the difficulty of coordinating very large GPU clusters. Hosted by Ravid Shwartz Ziv and Allen Roush. Watch the full conversation on the publisher’s YouTube channel.

Hosted by Ravid Shwartz Ziv, Allen Roush

Christopher Potts examines whether increasing token consumption translates into useful improvements in AI performance. The discussion covers evaluation beyond benchmarks, inference-time scaling, DSPy, interpretability, user expertise and architectural changes that could improve the economics of capable AI systems.

Hosted by Sam Charrington

John Langford of Microsoft AI Labs discusses whether compact implicit models of the world can improve data efficiency. The conversation examines belief-state compression, Transformer caches, JEPA-style objectives and his Next Latent research. It also covers the value of algorithmic research alongside scaling, agent-assisted experiments, open models, the history of CAPTCHA and the behavior of modern optimizers. Hosted by Ravid Shwartz Ziv and Allen Roush. Watch the full conversation on the publisher’s YouTube channel.

Hosted by Ravid Shwartz Ziv, Allen Roush

Max Welling discusses how ideas from physics may inform the next generation of artificial intelligence. The conversation examines physical structure, generative modelling and the relationship between learning systems and scientific discovery.

Hosted by Sam Charrington

University of Freiburg professor and Prior Labs co-founder Frank Hutter explains how TabPFN changed deep learning for tabular data. The episode examines in-context learning from synthetic pretraining, forecasting, architectural approaches to larger tables and the continuing roles of boosted trees and language models. Hutter also discusses moving research into a company, team autonomy, model licensing and building research organizations outside established technology hubs. Hosted by Ravid Shwartz Ziv and Allen Roush. Watch the full conversation on the publisher’s YouTube channel.

Hosted by Ravid Shwartz Ziv, Allen Roush

Google DeepMind research director Brendan O'Donoghue examines discrete diffusion as an alternative to autoregressive text generation. He discusses sample diversity, reinforcement learning, latency and potential on-device or robotics applications. The episode also addresses the costs of serving diffusion models, hardware trade-offs between computation and memory bandwidth, and practical limits on progress toward more capable AI. Hosted by Ravid Shwartz Ziv and Allen Roush. Watch the full conversation on the publisher’s YouTube channel.

Hosted by Ravid Shwartz Ziv, Allen Roush

Fatih Porikli examines why scaling image models alone does not guarantee visually correct results. He discusses separating scene planning from rendering, improving controllability and editing, and bringing high-resolution generation to edge devices, including the role of training objectives and reinforcement learning.

Hosted by Sam Charrington

Nathan Lambert discusses post-training and the prospects for open AI models, drawing on his work on OLMo at Ai2 and his writing on reinforcement learning from human feedback. Topics include capability gaps, the economics of the open ecosystem, training environments, continual learning and skepticism about recursive self-improvement. The conversation also examines research culture, concentrated talent and whether increased model spending translates into better products. Hosted by Ravid Shwartz Ziv and Allen Roush. Watch the full conversation on the publisher’s YouTube channel.

Hosted by Ravid Shwartz Ziv, Allen Roush

Damian Borth describes learning from trained neural networks themselves as a new source of training data. The conversation explores representations of model weights, transferring knowledge across architectures and tasks, and the possibility of specializing models with less computation by reusing what existing networks have learned.

Hosted by Sam Charrington

Dustin Podell discusses developments in image generation at Black Forest Labs, from diffusion models to flow matching and FLUX. The conversation considers image editing, local inference and the transition from producing pictures to supporting more capable visual workflows.

Hosted by Chris Benson, Daniel Whitenack

MIT professor Phillip Isola discusses what makes learned representations useful and why independently trained models can develop similar internal structure. He explores the platonic representation hypothesis, local clustering versus global geometry, and the neural thickets account of why pretrained networks can adapt readily to downstream tasks. Other topics include language models as world models, recurrent architectures, biological comparisons, and studying autonomous language-model agents as artificial life. Hosted by Ravid Shwartz Ziv and Allen Roush; watch the full research conversation on YouTube.

Hosted by Ravid Shwartz Ziv, Allen Roush

Michael Riegler discusses current uses of AI and language models, possible future developments and the concerns accompanying their spread. Conversation in Norwegian.

Andreas Tolias discusses foundation models trained on large neuroscience datasets and their potential to generalize across experimental settings.