The Overcooked Generalisation Challenge: Evaluating Cooperation with Novel Partners in Unknown Environments Using Unsupervised Environment Design

Constantin Ruhdorfer, Matteo Bortoletto, Anna Penzkofer, Andreas Bulling

Abstract:

We introduce the Overcooked Generalisation Challenge (OGC) – a new benchmark for evaluating reinforcement learning (RL) agents on their ability to cooperate with unknown partners in unfamiliar environments.
Existing work typically evaluated cooperative RL only in their training environment or with their training partners, thus seriously limiting our ability to understand agents’ generalisation capacity – an essential requirement for future collaboration with humans.
The OGC extends Overcooked-AI to support dual curriculum design (DCD).
It is fully GPU-accelerated, open-source, and integrated into the minimax DCD benchmark suite.
Compared to prior DCD benchmarks, where designers manipulate only minimal elements of the environment, OGC introduces a significantly richer design space: full kitchen layouts with multiple objects that require the designer to account for interaction dynamics between agents.
We evaluate state-of-the-art DCD algorithms alongside scalable neural architectures and find that current methods fail to produce agents that generalise effectively to novel layouts and unfamiliar partners.
Our results indicate that both agents and curriculum designers struggle with the joint challenge of partner and environment generalisation.
These findings establish OGC as a demanding testbed for cooperative generalisation and highlight key directions for future research.
We open-source our code.

Submission Length: Regular submission (no more than 12 pages of main content)

Changes Since Last Submission:

Next to the changes made during author-reviewer interaction for the camera-ready we:

1. Added additional random seeds for the tables in the appendix as requested by Reviewer vxd9.
2. Included a link to the code repository for reproducibility.
3. Added final details as requested: Link to this OpenReview forum and added month of publication (09/2025)

Assigned Action Editor: ~Pablo_Samuel_Castro1

Submission Number: 4960