A Coattention Enhanced Multimodal Feature Fusion With Inner Feature for Anomaly Detection
Current anomaly detection methods struggle with the nonlinear, dynamic, and multisource nature of industrial processes. This article proposes a novel end-to-end architecture with multimodal data dynamic inner feature fusion for anomaly detection in high-pressure grinding rolls (HPGRs). We employ a dual spatiotemporal autoencoder (AE) to extract features from both production process data and vibration signals. A coattention mechanism and a coarse-fine-grained feature fusion module enhance the model's ability to capture multimodal feature interactions and recover lost manifold information. An embedded autoregressive network module extracts consistent dynamic feature representations, further improving the AE's ability for interactive multimodal feature fusion. Finally, we propose a new dynamic inner feature fusion anomaly detection method specifically designed for nonlinear dynamic processes with multimodal data. The effectiveness of the proposed method is validated using real-world HPGR production process data.
Authors
- Wen Yu (ORCID: https://orcid.org/0000-0002-9540-7924)
- Deliang Zhang (ORCID: https://orcid.org/0000-0002-2367-5778)
- Tianyou Chai (ORCID: https://orcid.org/0000-0002-4623-1483)
- Quan Xu (ORCID: https://orcid.org/0009-0005-3964-9696)
- Hongshuo Sun (ORCID: https://orcid.org/0000-0002-9007-4091)
Institutions
- Centro de Investigación y de Estudios Avanzados del Instituto Politécnico Nacional (MX)
- Northeastern University (CN)
Publication Details
- Journal
- IEEE/ASME Transactions on Mechatronics
- Published
- 2024-12-03
- DOI
- https://doi.org/10.1109/tmech.2024.3491172
- Citations
- 2
- Primary Topic
- Anomaly Detection Techniques and Applications
- Type
- article
- Field-Weighted Citation Impact
- 0.69
Funders
- National Natural Science Foundation of China
- Fundamental Research Funds for the Central Universities
- Key Research and Development Program of Liaoning Province