A Comparative Study of Assessment Metrics for Imbalanced Learning

Zakarya Farou, Mohamed Aharrat, Tomás Horváth

Abstract: There are several machine learning algorithms addressing class imbalance problem, requiring standardized metrics for adequete performance evaluation. This paper reviews several metrics for imbalanced learning in binary and multi-class problems. We emphasize considering class separability, imbalance ratio, and noise when choosing suitable metrics. Applications, advantages, and disadvantages of each metric are discussed, providing insights for different scenarios. By offering a comprehensive overview, this paper aids researchers in selecting appropriate evaluation metrics for real-world applications.