Kaggle Grandmasters, Agent Skills, and Why Everyone Is Overfitting with Jean-Francois Puget (Nvidia)

NVIDIA researcher Jean-Francois Puget discusses evaluating agent skills and distinguishing real improvements from benchmark overfitting. Drawing on Kaggle competitions, he emphasizes validation that separates development feedback from final evaluation. The episode also considers coding agents, multi-agent software development, model-release claims and his team’s approach to the ARC-AGI competition. Hosted by Ravid Shwartz Ziv and Allen Roush. Watch the full conversation on the publisher’s YouTube channel.