Process Monitoring Using Domain-Adversarial Probabilistic Principal Component Analysis: A Transfer Learning Framework

Atefeh Daemi, R. Bhushan Gopaluni, Biao Huang

Abstract: Probabilistic principal component analysis (PPCA) is a feature extraction method that has been widely used in the field of process monitoring. However, PPCA assumes that training and testing data are drawn from the same input feature space with the same distributions. This assumption is not valid for complex processes that exhibit multiple operating modes and generate data with different distributions. In this article, we propose a novel transfer learning approach to monitoring processes with data from multiple distributions. To this end, we introduce a novel extension of PPCA, which is we refer to as the domain adversarial probabilistic principal component analysis (DAPPCA). DAPPCA algorithm automatically learns feature representations that are relevant across different operational modes. The algorithm extracts the most informative shared fault features and improves the accuracy of the fault detection model in a new operating mode using the knowledge transferred from previously known modes. The parameters of DAPPCA are estimated using a variational inference approach, and the monitoring statistics are calculated using the proposed model. We demonstrate the efficacy and real-time applicability of the proposed method with simulated and industrial examples.