AnoVox: A Benchmark for Multimodal Anomaly Detection in Autonomous Driving

Daniel Bogdoll, Iramm Hamdard, Lukas Roessler, Felix Geisler, Muhammed Bayram, Felix Wang, Jan Imhof, Miguel de Campos, Anushervon Tabarov, Yitian Yang, Martin Gontscharow, Hanno Gottschalk, J. Marius Zoellner

Keywords: autonomous driving, dataset, benchmark, anomaly detection, multimodal

Subject: Corner case mining and generation for autonomous driving

Confirmation: I have read and agree with the submission policies of ECCV 2024 and the W-CODA Workshop on behalf of myself and my co-authors.

Abstract: The scale-up of autonomous vehicles depends heavily on their ability to deal with rare objects on the road. In order to handle such situations, it is necessary to detect anomalies in the first place. Anomaly detection has made great progress in the past years but suffers from poorly designed benchmarks with a strong focus on camera data. In this work, we present AnoVox, the largest benchmark for ANOmaly detection in autonomous driving to date. AnoVox incorporates multimodal sensor data and spatial VOXel ground truth, allowing for the comparison of methods independent of their used sensor. We propose a formal definition of normality and provide a compliant training dataset. AnoVox is the first benchmark to contain both content and temporal anomalies.

Submission Number: 2