A Formal Approach and Testing Process for Failure Modes in Intelligent Algorithms

Nishan Xie, Hongping Ren, Rui Li, Qian Dong, Lingzhong Meng

Abstract: This paper proposes a formal approach and testing process for the failure modes of intelligent algorithms. The process first requires the establishment of a failure mode library specific to the algorithm domain. Subsequently, we introduce a formalized method for providing a standardized and comprehensive description of the failure modes. We developed a supporting system to parse the formal description statements, enabling the automatic generation of failure test cases based on the failure modes. Finally, we validated the effectiveness and practicality of our proposed testing process based on failure modes in the field of object detection algorithms, demonstrating the testing process’s outstanding effectiveness.

External IDs:dblp:conf/ats/XieRLDM24