World Models | John Langford (Microsoft AI Labs)
John Langford of Microsoft AI Labs discusses whether compact implicit models of the world can improve data efficiency. The conversation examines belief-state compression, Transformer caches, JEPA-style objectives and his Next Latent research. It also covers the value of algorithmic research alongside scaling, agent-assisted experiments, open models, the history of CAPTCHA and the behavior of modern optimizers. Hosted by Ravid Shwartz Ziv and Allen Roush. Watch the full conversation on the publisher’s YouTube channel.
Why All Models Learn the Same Thing with Phillip Isola (MIT)
MIT professor Phillip Isola discusses what makes learned representations useful and why independently trained models can develop similar internal structure. He explores the platonic representation hypothesis, local clustering versus global geometry, and the neural thickets account of why pretrained networks can adapt readily to downstream tasks. Other topics include language models as world models, recurrent architectures, biological comparisons, and studying autonomous language-model agents as artificial life. Hosted by Ravid Shwartz Ziv and Allen Roush; watch the full research conversation on YouTube.