Skip to content

About

Andrew Dai joins The Information Bottleneck to discuss language-model pre-training, next-token prediction, training-data quality and visual reasoning. The conversation examines counting and image understanding, world models and JEPA. Hosted by Ravid Shwartz-Ziv and Allen Roush.

More from this series

We use essential cookies to run the site. Optional analytics and public-page session replay help us improve World Wide. Learn more.