Your Mileage May Vary: How Empathy and Demographics Shape Human Preferences in LLM Responses

ACL ARR 2025 May Submission2218 Authors

Abstract: As large language models (LLMs) increasingly assist in subjective decision-making (e.g., moral reasoning, advice), it is critical to understand whose preferences they align with—and why. While prior work uses aggregate human judgments, demographic variation and its linguistic drivers remain underexplored. We present a comprehensive analysis of how demographic background and empathy level correlate with preferences for LLM-generated dilemma responses, alongside a systematic study of predictive linguistic features (e.g., agency, emotional tone). Our findings reveal significant demographic divides and identify markers (e.g., power verbs, tentative phrasing) that predict group-level differences. These results underscore the need for demographically informed LLM evaluation.

Paper Type: Long

Research Area: Human-Centered NLP

Research Area Keywords: Empathy, LLMs, subjectivity, emotions, demographics, human preferences, response analysis, evaluation

Contribution Types: Model analysis & interpretability, Data analysis

Languages Studied: English

Submission Number: 2218