Multi-dimensional ability diagnosis for machine learning algorithms

Qi Liu, Zheng Gong, Zhenya Huang, Chuanren Liu, Hengshu Zhu, Zhi Li, Enhong Chen, Hui Xiong

Abstract: We have proposed the cognitive diagnostic framework Camilla and a multi-dimensional metric Ability for providing both interpretable and reliable assessment of machine learning algorithms. To the best of our knowledge, this is the first comprehensive attempt for measuring the multifaceted strength of each machine learning algorithm by exploring the connections between the research on psychometric theories and machine learning evaluation.

External IDs:dblp:journals/chinaf/LiuGHLZLCX24