Defining Cultural Capabilities for AI Evaluation: A Taxonomy Grounded in Intercultural Communication Theory

Isar Nejadgholi, Masoud Kianpour, Krishnapriya Vishnubhotla, Maryam Molamohammadi

Keywords: Cultural Capability, AI Evaluation, Construct validity, Intercultural Communication

TL;DR: We introduce a taxonomy grounded in intercultural communication theory to define cultural capabilities that can be measured for AI.

Abstract: Tremendous efforts have been put into evaluating the inclusivity and effectiveness of AI systems across cultures. However, the cultural capabilities considered in much of the literature remain vaguely defined, are often used interchangeably, and are typically limited to recalling accurate information about various demographics, regions, and nationalities. To address this construct ambiguity, we draw from Intercultural Communication scholarship and propose a three-level taxonomy of AI-relevant cultural capabilities: **Cultural Awareness** answers *Does the model know?''*, **Cultural Sensitivity** answers *``How does it frame its knowledge?''*, and **Cultural Competence** answers *``Can it adapt as the interaction evolves?''*. Beyond conceptual clarification, we position this taxonomy as a practical tool for improving the validity and interpretability of AI evaluation in real-world, multicultural settings. Without such construct clarity, evaluation results risk overstating model capabilities and may lead to inappropriate deployment decisions in culturally sensitive contexts.

Email Sharing: We authorize the sharing of all author emails with Program Chairs.

Data Release: We authorize the release of our submission and author names to the public in the event of acceptance.

Submission Type: Provocation

Archival Status: Archival

Submission Number: 60