Whose Emotions and Moral Sentiments do Language Models Reflect?

Anonymous

Abstract: Language models (LMs) are known to represent the perspectives of some social groups better than others, which may impact their performance, especially on subjective tasks such as content moderation and hate speech detection. To explore how LMs represent different perspectives, existing research focused on positional alignment, i.e., how closely the models mimic the opinions and stances of different groups, e.g., liberals or conservatives. However, human communication also encompasses emotional and moral dimensions. We define the problem of affective alignment, which measures how LMs' emotional and moral tone represents those of different groups. By comparing the affect of responses generated by 36 LMs to the affect of Twitter messages, we observe significant misalignment of LMs with both ideological groups. This misalignment is larger than the partisan divide in the U.S. Even after steering the LMs towards specific ideological perspectives, the misalignment and liberal tendencies of the model persist, suggesting a systemic bias within LMs.

Paper Type: long

Research Area: Computational Social Science and Cultural Analytics

Contribution Types: Model analysis & interpretability, NLP engineering experiment

Languages Studied: English

Preprint Status: We are considering releasing a non-anonymous preprint in the next two months (i.e., during the reviewing process).

A1: yes

A1 Elaboration For Yes Or No: Limitations

A2: yes

A2 Elaboration For Yes Or No: Ethics Statement

A3: yes

A3 Elaboration For Yes Or No: Abstract and Section 1

B: yes

B1: yes

B1 Elaboration For Yes Or No: Section 2.1 and Appendix A.1

B2: n/a

B3: yes

B3 Elaboration For Yes Or No: Ethics Statement

B4: yes

B4 Elaboration For Yes Or No: Ethics Statement

B5: n/a

B6: n/a

C: yes

C1: yes

C1 Elaboration For Yes Or No: Appendix A.2

C2: n/a

C3: yes

C3 Elaboration For Yes Or No: Section 3

C4: yes

C4 Elaboration For Yes Or No: Appendix A.2

D: no

E: yes

E1: no

E1 Elaboration For Yes Or No: Only used for grammar checks