Your Ranking Model Is Optimizing the Wrong Thing with Zoe Weil
Oct 15, 2026
The TWIML AI Podcast
How to Engineer AI Inference Systems
Artificial Intelligence, Computer Science, Distributed Computing and podcast with Philip Kiely
The TWIML AI Podcast, Hosted by Sam Charrington
About
Philip Kiely surveys inference engineering at the intersection of GPU programming, applied research and distributed systems. Topics include batching, quantisation, speculative execution, cache reuse and workload-specific serving, alongside the choices between hosted APIs, dedicated deployments and internal platforms for multimodal and agent applications.
Topics
inference engineeringGPU programmingdistributed systemsbatchingquantisationspeculative executioncache reuseworkload-specific servingagent applications
More from this series
More from The TWIML AI Podcast
All episodesWhy Jev Is Changing How We Build With AI with Diogo Almeida
Oct 6, 2026The TWIML AI PodcastFrom Math Olympiads to Navier-Stokes: How Fast Is AI Progressing?
Sep 29, 2026The TWIML AI PodcastFrom Voice Agents to AI Avatars with Alexander Smola
Sep 16, 2026The TWIML AI Podcast
More with Sam Charrington
All their workDo AI Tokenomics Matter More Than Model Benchmarks? with Christopher Potts
Episode · Sep 9, 2026The TWIML AI PodcastWorld Models and the Future of Spatial AI with Justin Johnson
Episode · Sep 1, 2026The TWIML AI PodcastWhy the Next AI Breakthrough May Come from Physics with Max Welling
Episode · Aug 25, 2026The TWIML AI PodcastWhy Image Generation Needs More Than Bigger Models with Fatih Porikli
Episode · Aug 12, 2026The TWIML AI Podcast
New episodes in Artificial Intelligence
All episodesLess about Models; More about Architecture
Sep 3, 2026Practical AIFrom AGENTS.md to Enterprise Deployment
Sep 24, 2026Practical AIOpen models and the future of Physical AI with NVIDIA
Oct 1, 2026Practical AILive from ICM 2026: What Is Math For in the Age of AI?
Sep 3, 2026The Joy of Why
Upcoming talks in Artificial Intelligence
All seminarsHow to address the use of AI in physical science and education?
Nov 3, 2026Armin TavakoliBeyond Chatbots: Applications and Foundations of Machine Learning
Nov 5, 2026Daniel Lehner