Never mind the metrics - what about the uncertainty? Visualising binary confusion matrix metric distributions to put performance in perspective

David R. Lovell, Dimity Miller, Jaiden Capra, Andrew P. Bradley

Abstract: There are strong incentives to build classification systems that show outstanding performance on various datasets and benchmarks. This can encourage a narrow focus on models and the performance met...