Self-Supervised CNN–Transformer Anomaly Detection for Bearing Health Monitoring

Reliable bearing fault detection is essential for predictive maintenance in industrial systems; however, obtaining labelled fault data is often expensive, time-consuming, and impractical in real-world deployments. To address this challenge, this study proposes a healthy-only self-supervised anomaly detection framework for bearing health monitoring using vibration measurements. The proposed approach combines convolutional neural networks and Transformer-based temporal modelling to learn informative representations from healthy vibration signals without requiring fault labels during representation learning. Three self-supervised learning strategies—reconstruction-based, contrastive, and a unified contrastive–reconstruction objective—are investigated to evaluate the effectiveness of different representation learning approaches. The learned latent representations are subsequently analysed using Isolation Forest and Mahalanobis-distance anomaly scoring methods. To provide a realistic assessment of generalisation, a strict grouped cross-validation protocol is employed, where data are partitioned at the sample level to prevent information leakage between training and testing sets. Furthermore, prevalence-aware experiments are conducted under 5% and 10% fault prevalence scenarios to assess deployment robustness. Experimental results on the Paderborn bearing dataset demonstrate that the proposed CNN + Transformer model trained with combined contrastive and reconstruction objectives and evaluated using Isolation Forest achieves the best overall performance, obtaining a ROC-AUC of 0.878±0.015, a PR-AUC of 0.958±0.005, and an F1-score of 0.590±0.040. The results consistently outperform classical feature-based approaches, One-Class SVM, and autoencoder baselines. Ablation analysis further shows that combining contrastive and reconstruction objectives produces more informative representations than either objective alone. The findings demonstrate that the proposed healthy-only self-supervised framework provides an effective and label-efficient approach for rolling bearing anomaly detection and shows promise for predictive maintenance applications where labelled fault data are limited or unavailable.

Authors

Institutions

Publication Details

Journal
Processes
Published
2026-07-30
DOI
https://doi.org/10.3390/pr14152452
Primary Topic
Machine Fault Diagnosis Techniques
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Self-Supervised CNN–Transformer Anomaly Detection for Bearing Health Monitoring

Alex Shenfield, Augustine Ikpehai, Hongwei Zhang, Syed Itrat Hussain Zaidi
Processes
Machine Fault Diagnosis Techniques
article

Self-Supervised CNN–Transformer Anomaly Detection for Bearing Health Monitoring

Alex Shenfield, Augustine Ikpehai, Hongwei Zhang, Syed Itrat Hussain Zaidi
article en

Abstract

Reliable bearing fault detection is essential for predictive maintenance in industrial systems; however, obtaining labelled fault data is often expensive, time-consuming, and impractical in real-world deployments. To address this challenge, this study proposes a healthy-only self-supervised anomaly detection framework for bearing health monitoring using vibration measurements. The proposed approach combines convolutional neural networks and Transformer-based temporal modelling to learn informative representations from healthy vibration signals without requiring fault labels during representation learning. Three self-supervised learning strategies—reconstruction-based, contrastive, and a unified contrastive–reconstruction objective—are investigated to evaluate the effectiveness of different representation learning approaches. The learned latent representations are subsequently analysed using Isolation Forest and Mahalanobis-distance anomaly scoring methods. To provide a realistic assessment of generalisation, a strict grouped cross-validation protocol is employed, where data are partitioned at the sample level to prevent information leakage between training and testing sets. Furthermore, prevalence-aware experiments are conducted under 5% and 10% fault prevalence scenarios to assess deployment robustness. Experimental results on the Paderborn bearing dataset demonstrate that the proposed CNN + Transformer model trained with combined contrastive and reconstruction objectives and evaluated using Isolation Forest achieves the best overall performance, obtaining a ROC-AUC of 0.878±0.015, a PR-AUC of 0.958±0.005, and an F1-score of 0.590±0.040. The results consistently outperform classical feature-based approaches, One-Class SVM, and autoencoder baselines. Ablation analysis further shows that combining contrastive and reconstruction objectives produces more informative representations than either objective alone. The findings demonstrate that the proposed healthy-only self-supervised framework provides an effective and label-efficient approach for rolling bearing anomaly detection and shows promise for predictive maintenance applications where labelled fault data are limited or unavailable.

ProcessesVol. 14(15)
Sheffield Hallam University (GB)
Sheffield Hallam University
Openalex Percentile: Top 11%
Machine Fault Diagnosis Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.