Investigating the Link Between Representational Similarity and Model Interactions

ICLR 2026 Conference Submission19896 Authors

19 Sept 2025 (modified: 08 Oct 2025)ICLR 2026 Conference SubmissionEveryoneRevisionsBibTeXCC BY 4.0
Keywords: Representational similarity, multi-agent system, cooperation, creativity
TL;DR: We examine whether representational similarity can predict the interactive behaviors of models.
Abstract: Researchers have shown that neural similarity among humans predicts social closeness and cooperative success, whereas innovation often emerges from interactions among dissimilar individuals. We investigate whether these principles extend to artificial intelligence by examining interactions between large language models (LLMs). In our experiments, 276 model pairs interact across eight collaborative tasks spanning both cooperation and novelty. We find that pairs with more similar representation spaces achieve significantly higher cooperation but exhibit reduced novelty and creativity. These findings suggest that representational similarity can be an important consideration in multi-agent system design.
Supplementary Material: zip
Primary Area: alignment, fairness, safety, privacy, and societal considerations
Submission Number: 19896
Loading