Rethinking Pre-Training for Agentic AI

Aakanksha Chowdhery examines changes to pre-training that could support reasoning, planning and multi-step agent workflows. Drawing on large-model training experience, she discusses next-token prediction, attention and loss functions, trajectory data, context retrieval, error recovery and the role of scale in learning tool use.