Index system construction and weight distribution method based on improved credibility

Liang Chen, Wang Sule, Lulu Zhao

Abstract: In this paper, we construct a comprehensive operational effectiveness assessment index system from the perspective of operational effectiveness and system performance. The selected indicators in this index system affect the assessment results deeply. Then, we assess the reliability of the index system. We test the proposed method in a simulation scenario using single-factor tests. A mean value of the sensitivity of single indicator is calculated by repeating the test several times, in which the value of a single index changes while others keep constant. Finally, we reconstruct an effectiveness assessment index system by eliminating the indicators which have little impact on the effectiveness values. The proposed method provides a new way to assess the index system of a target system objectively and comprehensively and to distribute the index weights reasonably. The assessment result shows the objectivity and reliability of the proposed method.