Enhancing industrial machinery maintenance through advanced fault and novelty detection using variational autoencoder and hybrid transformer model

In the context of Industry 4.0, new sensing and communication technologies have unlocked vast amounts of process data, offering significant potential for its transformation into actionable insights to support manufacturing decisions. The reliable detection and diagnosis of faults in rolling element bearings pose a significant challenge for condition-based maintenance and fault detection and diagnosis (FDD), which are critical strategies for enhancing equipment reliability and reducing operational costs. Deep learning methods, such as convolutional neural networks (CNNs), can extract features from vibration signals compared to traditional signal processing. However, these methods in isolation are insufficient to reliably detect novel fault conditions and faults in variable working environments. Also, existing novelty and anomaly detection criteria are not accurate enough to correctly distinguish novel or unseen faults. This study introduces a multi-fault detection framework leveraging a variational autoencoder with Mahalanobis distance (MD) novelty scores for unknown condition detection and a hybrid CNN-Swin transformer (Swin-T) model for incremental learning and fault classification. Using frequency-domain transformation and image-based representation of vibration signals, a hybrid model with a CNN-based feature extractor after projecting to the patch embedding layer of a simplified Swin-T model is trained incrementally with novel conditions to allow continuous learning and adaptation. Extensive validation with three separate datasets from fault simulation test rigs demonstrates the superior performance of the method over traditional and cutting-edge models in FDD and novelty detection (ND), achieving near-perfect accuracy (99.7%), precision (99.8%), recall (99.6%), and F1 score (99.7%). ND outperformed traditional approaches with an MD novelty score threshold yielding a true-positive rate of 98.9% and a false-positive rate of 1.2%. Additionally, incremental learning improved classification accuracy by up to 5.4% for newly introduced fault types, highlighting its adaptability. These results demonstrate the framework’s ability to enhance reliability and efficiency in industrial machinery maintenance by identifying both known and novel fault conditions with high precision.

Authors

Institutions

Publication Details

Journal
Structural Health Monitoring
Published
2025-03-26
DOI
https://doi.org/10.1177/14759217251321764
Citations
2
Primary Topic
Fault Detection and Control Systems
Type
article
Field-Weighted Citation Impact
2.43
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Enhancing industrial machinery maintenance through advanced fault and novelty detection using variational autoencoder and hybrid transformer model

Hind Hamdaoui, Shixi Tang, Jinan Gu, Looh George Ashwehmbom et al.
2 citations
Structural Health Monitoring
Fault Detection and Control Systems
2.43
article

Enhancing industrial machinery maintenance through advanced fault and novelty detection using variational autoencoder and hybrid transformer model

Hind Hamdaoui, Shixi Tang, Jinan Gu, Looh George Ashwehmbom, Looh Augustine Ngiejungbwen, Wenbo Wang
article en
2 citations

Abstract

In the context of Industry 4.0, new sensing and communication technologies have unlocked vast amounts of process data, offering significant potential for its transformation into actionable insights to support manufacturing decisions. The reliable detection and diagnosis of faults in rolling element bearings pose a significant challenge for condition-based maintenance and fault detection and diagnosis (FDD), which are critical strategies for enhancing equipment reliability and reducing operational costs. Deep learning methods, such as convolutional neural networks (CNNs), can extract features from vibration signals compared to traditional signal processing. However, these methods in isolation are insufficient to reliably detect novel fault conditions and faults in variable working environments. Also, existing novelty and anomaly detection criteria are not accurate enough to correctly distinguish novel or unseen faults. This study introduces a multi-fault detection framework leveraging a variational autoencoder with Mahalanobis distance (MD) novelty scores for unknown condition detection and a hybrid CNN-Swin transformer (Swin-T) model for incremental learning and fault classification. Using frequency-domain transformation and image-based representation of vibration signals, a hybrid model with a CNN-based feature extractor after projecting to the patch embedding layer of a simplified Swin-T model is trained incrementally with novel conditions to allow continuous learning and adaptation. Extensive validation with three separate datasets from fault simulation test rigs demonstrates the superior performance of the method over traditional and cutting-edge models in FDD and novelty detection (ND), achieving near-perfect accuracy (99.7%), precision (99.8%), recall (99.6%), and F1 score (99.7%). ND outperformed traditional approaches with an MD novelty score threshold yielding a true-positive rate of 98.9% and a false-positive rate of 1.2%. Additionally, incremental learning improved classification accuracy by up to 5.4% for newly introduced fault types, highlighting its adaptability. These results demonstrate the framework’s ability to enhance reliability and efficiency in industrial machinery maintenance by identifying both known and novel fault conditions with high precision.

Structural Health Monitoring
Jiangsu University (CN), Yancheng Teachers University (CN), Hunan Agricultural University (CN)
Openalex Percentile: Top 13%
Fault Detection and Control Systems
2.43
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.