VeriRole: Verifiable Role-Awareness through Hint-Guided Reinforcement Learning

ICLR 2026 Conference Submission10582 Authors

Keywords: role-playing character agent, RPCA, LLM

TL;DR: We propose the VeriRole framework, which improves AI's role-playing consistency by generating reward signals from verifiable "hints" extracted from the conversation.

Abstract: Maintaining role-awareness in Role-Playing Conversational Agents (RPCAs) is a significant challenging, largely because the creative nature of role-playing makes it difficult to design verifiable reward signals for reinforcement learning (RL). To address this, we propose VeriRole, a new framework designed to enhance the role-awareness of agents through a structured, verifiable reasoning process. The core of our framework is a 'hint' mechanism, designed to first extract deterministic cues from the context, before the main response generation.Building on these hints, we introduce a Verifiable Role-Awareness Reward (VRAR) to provide a verifiable signal for role-awareness. Experimental results demonstrate the effectiveness of our approach. Our Qwen2.5-32B model, optimized with VeriRole, achieves an 18.9% and 4.55% increase in average scores on the RAIDEN and CharacterEval benchmarks, respectively. These results confirm that VeriRole can effectively quantify and improve role-awareness, leading to superior persona consistency and robustness. To ensure reproducibility, all prompts are detailed in the Appendix, and the associated training data will be made publicly available.

Primary Area: applications to computer vision, audio, language, and other modalities

Submission Number: 10582