Math Takes Two: A test for emergent mathematical reasoning in communication

Samuel Cooper, Michael Harry Cooper

Keywords: Emergent Communication, Compositional Language, Symbolic Reasoning, Mathematical Abstraction, Visual Grounding, Multi-Agent Learning

TL;DR: Math Takes Two proposes a benchmark to test whether AI agents can develop emergent mathematical reasoning through communication alone

Abstract: Although language models demonstrate remarkable proficiency on mathematical benchmarks, it remains unclear whether this reflects true mathematical reasoning or statistical pattern matching over learning formal syntax. Most existing evaluations rely on symbolic problems grounded in established mathematical conventions, limiting insight into the models' ability to construct abstract concepts from first principles. In this work, we propose Math Takes Two, a new benchmark designed to assess the emergence of mathematical reasoning through communication. Motivated by the hypothesis that mathematical cognition in humans co-evolved with the need for precise communication, our benchmark tests whether two agents, without prior mathematical knowledge, can develop a shared symbolic protocol to solve a visually grounded task where the use of a numerical system facilitates extrapolation. Unlike many current datasets, our benchmark eschews predefined mathematical language, instead requiring agents to discover latent structure and representations from scratch. Math Takes Two thus provides a novel lens through which to conceptualize, develop and evaluate models with emergent numerical reasoning capabilities.

Paper Type: New Full Paper

Submission Number: 57