Proactive Agents for the Web

Devi Parikh discusses browser agents that act through visually grounded models. The conversation examines screenshots as an interface, training with supervised learning, rejection sampling and reinforcement learning, and coordinating tools and sub-agents. It considers reliability and the progression from background monitoring to autonomous web tasks.