CoMind: Towards Community-Driven Agents for Machine Learning Engineering

ICLR 2026 Conference Submission15890 Authors

Keywords: LLM Agent

TL;DR: We introduce MLE-Live, a live framework for evaluating ML agents in community-driven settings, and propose CoMind, a state-of-the-art agent that collaborates and competes like a real Kaggle participant.

Abstract:

Large language model (LLM) agents show promise in automating machine learning (ML) engineering. However, existing agents typically operate in isolation on a given research problem, without engaging with the broader research community, where human researchers often gain insights and contribute by sharing knowledge. To bridge this gap, we introduce MLE-Live, a live evaluation framework designed to assess an agent's ability to communicate with and leverage collective knowledge from a simulated Kaggle research community. Building on this framework, we propose CoMind, an multi-agent system designed to actively integrate external knowledge.
CoMind employs an iterative parallel exploration mechanism, developing multiple solutions simultaneously to balance exploratory breadth with implementation depth.
On 75 past Kaggle competitions within our MLE-Live framework, CoMind achieves a 36% medal rate, establishing a new state of the art. Critically, when deployed in eight live, ongoing competitions, CoMind outperforms 92.6% of human competitors on average, placing in the top 5% on three official leaderboards and the top 1\% on one.

Primary Area: applications to computer vision, audio, language, and other modalities

Submission Number: 15890