Browser agents

Dhruv Batra connects embodied AI research with browser agents at Yutori. He explains why navigation from pixels to actions links virtual robots and web interaction, then discusses reinforcement learning on live websites, simulation-to-reality gaps and teleoperation. The conversation also examines competing views of intelligence, claims about scaling and the implications of agent-mediated browsing for the web. Hosted by Ravid Shwartz Ziv and Allen Roush. Watch the full conversation on the publisher’s YouTube channel.

Devi Parikh discusses browser agents that act through visually grounded models. The conversation examines screenshots as an interface, training with supervised learning, rejection sampling and reinforcement learning, and coordinating tools and sub-agents. It considers reliability and the progression from background monitoring to autonomous web tasks.