Differences in Detection: Explainability Where it Matters

CVPR 2026 Workshop HOW Proceedings Track Submission32 Authors

Include In Proceedings: Yes, include in CVPR proceedings

Public: Yes,

Keywords: object detection, differences, evaluation, mean average precision, mAP, tide, error analysis, explainability, ms-coco, deeplearning

TL;DR: New method to compare the predictions and errors of two object detection models directly which can be useful to apply explainability methods to relevant examples.

Abstract:

We propose Differences in Detection (DnD), an intuitive method to compare two object detection models. Based on the same matching algorithm, it complements the standard metrics of mean Average Precision (mAP ) and TIDE error analysis with the ability to compare two models directly. More specifically, we calculate the intersection of ground truth labels that are recognized by both models, followed by the corresponding difference sets and the complement set of ground truth labels that are missed by both models. The resulting comparison is more direct and intuitive than a comparison of independent summary statistics. It reveals individual and shared mistakes and becomes particularly interesting when combined with error types. In this case, the differences in detection errors can be analyzed naturally in a standard confusion matrix. While valuable in itself, we believe that one of the best applications of DnD is to guide explainability methods such as ODAM towards metric-relevant examples, grounded in structured subsets. The code for our method is available here:

https://github.com/JohannesTheo/differences-in-detection

Submission Number: 32