Real-Time Trust Verification for Safe Agentic Actions using TrustBench

AAAI 2026 Workshop TrustAgent Submission22 Authors

Keywords: agentic AI, trust calibration, runtime verification, LLM-as-a-Judge evaluation

TL;DR: TrustBench introduces an epistemic trust framework for agentic LLMs that calibrates self-confidence using LLM-as-a-Judge evaluations and enforces real-time verification through domain-specific trust scoring.

Abstract:

As large language models evolve from conversational assistants to autonomous agents, ensuring trustworthiness requires a fundamental shift from post-hoc evaluation to real-time action verification. Current frameworks like AgentBench evaluate task completion, while TrustLLM and HELM assess output quality after generation. However, none of these prevent harmful actions during agent execution. We present TrustBench, a dual-mode framework that (1) benchmarks trust across multiple dimensions using both traditional metrics and LLM-as-a-Judge evaluations, and (2) provides a toolkit agents invoke before taking actions to verify safety and reliability. Unlike existing approaches, TrustBench intervenes at the critical decision point: after an agent formulates an action but before execution. Domain-specific plugins encode specialized safety requirements for healthcare, finance, and technical domains.
Across multiple agentic tasks, TrustBench reduced harmful actions by 87%. Domain-specific plugins outperformed generic verification, achieving 35% greater harm reduction. With sub-200ms latency, TrustBench enables practical real-time trust verification for autonomous agents.

Submission Number: 22