Fine-Tuning as Repair? Care Ethics and Situated Knowledges in LLM Alignment Cultures

Lara Dal Molin, Jacqueline Rowe

Keywords: Large Language Models; Fine-Tuning; Gender Bias; Situated Knowledges; Care Ethics; Repair

Abstract: We explore the current culture of alignment and evaluation in Large Language Models (LLMs) through a novel interdisciplinary fine-tuning pipeline that centers participant expertise, situated knowledges, and subjective experiences of LLM interactions. We demonstrate proof of concept through an experimental implementation focused on LLMs' gendered biases. Through fine-tuning LLaMA 3.1 8B on a participatory dataset curated with 65 participants, and evaluating the fine-tuned model for gender bias with another 19 participants in an interactive fashion, we posit that it is possible to conceptualise fine-tuning as an act of `repair' when grounded in principles of care, consent and agency.

Email Sharing: We authorize the sharing of all author emails with Program Chairs.

Data Release: We authorize the release of our submission and author names to the public in the event of acceptance.

Submission Number: 50