User-Assistant Bias in LLMs

ICLR 2026 Conference Submission13724 Authors

Keywords: LLM, AI Safety, Multi-Turn Conversation, Human-AI Interaction

Abstract: Large language models (LLMs) can bias towards relying on their own or the user's information in chat history, leading to overly stubborn or agreeable behaviors in multi-turn conversations. In this paper, we formalize this model characteristic as user-assistant bias and introduce an 8k multi-turn conversation dataset UserAssist, which we use to benchmark, understand and manipulate the user-assistant bias in frontier LLMs. Leveraging UserAssist-test, we first benchmark the user-assistant bias of 26 commercial and 26 open-weight models. Commercial models show various levels of user bias. Evaluation on open-weight models reveals significant user bias in the instruction-tuned models, and weak user bias in reasoning (or reasoning-distilled) models. We then perform controlled fine-tuning experiments to pinpoint the post-training recipe contributing to these bias shifts: human preference alignment increases user bias, while training on chain-of-thought reasoning traces decreases it. Finally, we demonstrate that user-assistant bias can be bidirectionally adjusted by performing direct preference optimization (DPO) on UserAssist-train, and generalizes well to both in-domain and out-of-domain conversations. Our results provide insights into how the LLM integrates information from different sources, and also a viable way to detect and control model abnormalities.

Primary Area: alignment, fairness, safety, privacy, and societal considerations

Submission Number: 13724