Open-Source Foosball Benchmark for Deep Reinforcement Learning

Matthew So, Kwansoo Lee, Judah Goldfeder, Hod Lipson

Keywords: Reinforcement Learning, Machine Learning, Simulation, Mujoco, RL, AI, Artificial Intelligence, Foosball, Game Simulation, Physics Simulation, Foosball Benchmark, Deep Reinforcement Learning, Continuous Control, Sim-to-Real Transfer, MuJoCo Physics Simulation, Domain Randomization, Vision-Based RL, Multi-Agent Competition, End-to-End Control, Robotics Benchmark

Abstract: Foosball is a fast-paced, strategy-driven table game that requires sub-second decision-making, fine motor control, and dynamic tactics. Reinforcement Learning (RL) algorithms are widely used for AI agents to implicitly learn the physical world. In this work, we present a new open-source framework designed for evaluating end-to-end deep RL algorithms in a simulated foosball environment. Our platform includes a high-fidelity physics simulation environment built in MuJoCo, enabling analysis of performance transfer from virtual to real-world conditions. This platform is designed to advance the development of competitive agents capable of robust, adaptive behavior and effective sim-to-real generalization, serving as a standardized resource for the broader RL community.

Submission Number: 39