Topic: runtime policies

Devvret Rishi discusses how agents with access to tools and external systems change the security requirements of generative AI applications. He examines the limitations of static controls and the need for runtime policies, observability and recovery mechanisms as agent workflows become more capable.

Rashmi Shetty explains how Capital One develops multi-agent systems for regulated services. The discussion covers intent disambiguation, tool use and human handoffs, alongside platform design, runtime policies, observability and evaluation. It also examines model specialisation through fine-tuning and distillation, and learning from production feedback.