3 results
Philip Kiely surveys inference engineering at the intersection of GPU programming, applied research and distributed systems. Topics include batching, quantisation, speculative execution, cache reuse and workload-specific serving, alongside the choices between hosted APIs, dedicated deployments and internal platforms for multimodal and agent applications.
Hosted by Sam Charrington
Published Apr 30, 2026
Stefano Ermon discusses adapting diffusion models to language and code generation. Topics include discrete token spaces, parallel token generation, Mercury 2, and trade-offs with autoregressive models. The conversation examines training, serving and post-training challenges, controllable generation and possible directions for multimodal diffusion systems.
Hosted by Sam Charrington
Published Mar 26, 2026
Siddhant Pardeshi describes autonomous software-development systems that combine knowledge graphs and vector search to navigate large repositories. The conversation examines context engineering, agent orchestration, model-specific prompting and persistent feedback. It also considers how evaluation should reflect security, maintainability and acceptance of the resulting software.
Hosted by Sam Charrington
Published Mar 10, 2026