Enhancing Persona Following at Decoding Time via Dynamic Importance Estimation for Role-Playing Agents

ICLR 2026 Conference Submission16516 Authors

Keywords: Agent-Based Simulation; Role-Playing Language Agents; Persona Following; Inference-Time Alignment

TL;DR: We propose PDD, a novel framework for enhancing RPLAs with predefined profiles across diverse contextual scenarios during decoding.

Abstract:

The utility of Role-Playing Language Agents in sociological research is growing alongside the adoption of Large Language Models. For realism in social simulation, these agents must adhere to their personas defined by character profiles, yet existing strategies—static prompt engineering or costly fine-tuning—fail to adapt personas to dynamic scenarios. Psychological theories, such as the Cognitive-Affective Personality Systems, provide a crucial explanation for this failure: a persona's influence on behavior is not static but varies with the scenarios. This context-dependence highlights the critical need for adaptive persona management. To address this gap, we propose a novel, theory-driven method that dynamically estimates context-dependent persona importance and integrates it into weighted reward-guided decoding, enabling inference-time persona following. Specifically, we introduce Persona Dynamic Decoding (PDD) framework that consists of two key components:
(1) Persona Importance Estimation (PIE) module, which dynamically quantifies the contextual importance of persona attributes without requiring ground-truth supervision; and (2) Persona-Guided Inference-Time Alignment (PIA) paradigm, which leverages these importance scores to construct weighted multi-objective rewards and modulate generation probabilities during inference. Extensive experiments show the effectiveness of our method in utterance consistency and behavioral fidelity.

Primary Area: applications to computer vision, audio, language, and other modalities

Submission Number: 16516