Nocturne: a scalable driving benchmark for bringing multi-agent learning one step closer to the real worldDownload PDF

06 Jun 2022, 16:42 (modified: 15 Jan 2023, 20:34)NeurIPS 2022 Datasets and Benchmarks Readers: Everyone
Keywords: Multi-Agent Reinforcement Learning, Benchmark, Simulator, Self-Driving, Human-Modeling
TL;DR: We introduce a fast, data-driven simulator for studying multi-agent partially observed coordination in human driving.
Abstract: We introduce \textit{Nocturne}, a new 2D driving simulator for investigating multi-agent coordination under partial observability. The focus of Nocturne is to enable research into inference and theory of mind in real-world multi-agent settings without the computational overhead of computer vision and feature extraction from images. Agents in this simulator only observe an obstructed view of the scene, mimicking human visual sensing constraints. Unlike existing benchmarks that are bottlenecked by rendering human-like observations directly using a camera input, Nocturne uses efficient intersection methods to compute a vectorized set of visible features in a C++ back-end, allowing the simulator to run at $2000+$ steps-per-second. Using open-source trajectory and map data, we construct a simulator to load and replay arbitrary trajectories and scenes from real-world driving data. Using this environment, we benchmark reinforcement-learning and imitation-learning agents and demonstrate that the agents are quite far from human-level coordination ability and deviate significantly from the expert trajectories.
Supplementary Material: pdf
License: MIT License
Author Statement: Yes
Contribution Process Agreement: Yes
In Person Attendance: Yes
28 Replies