Combining expert knowledge and unsupervised learning techniques for anomaly detection in aircraft flight data

Daniel L. C. Mack, Gautam Biswas, Hamed Khorasgani, Dinkar Mylaraswamy, Raj Bharadwaj

Abstract: Fault detection and isolation schemes are designed to detect the onset of adverse events during operations of complex systems, such as aircraft, power plants, and industrial processes. In this paper, we combine unsupervised learning techniques with expert knowledge to develop an anomaly detection method to find previously undetected faults from a large database of flight operations data. The unsupervised learning technique combined with a feature extraction scheme applied to the clusters labeled as anomalous facilitates expert analysis in characterizing relevant anomalies and faults in flight operations. We present a case study using a large flight operations data set, and discuss results to demonstrate the effectiveness of our approach. Our method is general, and equally applicable to manufacturing processes and other industrial applications.