A Self-Attention Mechanism Integrating Adaptive Double Subspace for Fault Detection in Industrial Processes

The self-attention mechanism has advantages in analyzing the internal characteristics of data and capturing local information. Therefore, it is applied to fault detection. Since complex industrial processes usually contain a mixture of properties, such as nonlinearity, dynamics, and non-Gaussianity, this places higher demands on fault detection methods. To further improve the performance of the self-attention mechanism for fault detection in complex industrial processes, an innovative self-attention mechanism integrating the adaptive double subspace (ISA-ADS) method is proposed for fault detection. First, the query matrix, the key matrix, and the value matrix of the self-attention mechanism are designed so that they can better focus on local information through the adaptive sample weight allocation strategy. At the same time, this design reduces the interference of nonlinear and noisy information and amplifies the impact of important fault information in the sample. Second, considering the problem of Gaussian and non-Gaussian distributions of the data and the different degrees of influence of different subspaces on the final process monitoring results, an adaptive Gaussian and non-Gaussian double subspace fault detection model based on the self-attention output matrix is established, which adaptively assigns different weights to different subspaces by determining their importance. The statistics of different subspaces are fused using the Bayesian inference and a new adaptive monitoring statistic is constructed to obtain a more accurate monitoring of the process state. Finally, the ISA-ADS is validated using the Tennessee Eastman (TE) process and the actual polyethylene production process. The results show that ISA-ADS has a low false alarm rate and a high fault detection rate, verifying the effectiveness of its fault detection performance.