Stateful Monitoring and Responsible Deployment of AI Agents

Debmalya Biswas

Abstract: AI agents can be disruptive given their potential to compose existing models and agents. Unfortunately, developing and deploying multi-agent systems at scale remains a challenging problem. In this paper, we specifically focus on the challenges of monitoring stateful agents and deploying them in a responsible fashion. We introduce a reference architecture for AI agent platforms, highlighting the key components to be considered in designing the respective solutions. From an agent monitoring perspective, we show how a snapshot based algorithm can answer different types of agent execution state related queries. On the responsible deployment aspect, we show how responsible AI dimensions relevant to AI agents can be integrated in a seamless fashion with the underlying AgentOps pipelines.