WT-STCA-ViT: Window-transform synergistic spectro-temporal channel attention Vision Transformer for robust bearing fault diagnosis

Abstract Reliable bearing fault diagnosis under variable operating conditions and severe noise remains challenging because empirically selected time-frequency front ends may produce degraded representations, while generic attention mechanisms lack explicit sensitivity to fault-related spectral structures. To address these limitations, this study proposes a robust cascaded framework termed window-transform synergistic spectro-temporal channel attention Vision Transformer (WT-STCA-ViT), which integrates a window-enhanced Fourier-based synchrosqueezing transform (FSST) with a spectro-temporal channel attention Vision Transformer (STCA-ViT). Specifically, a parameterized $\\alpha {\\rm{ - exponential Kaiser - Blackman}}$ $(\\alpha {\\rm{ - EKB}})$ window family and a task-constrained parameter screening strategy are established to optimize spectral concentration and transient localization, mitigating energy spreading across noisy scenarios. The resulting high-resolution time-frequency maps are encoded using a pretrained Vision Transformer (ViT) backbone and refined via the proposed frequency-axis-structure-aware spectro-temporal channel attention (STCA) mechanism, which generates frequency-dependent channel weights to calibrate band-level features while suppressing noise-dominated and irrelevant feature responses. Furthermore, a lightweight post-Transformer encoder and LoRA adapters are coupled to achieve global token-level refinement and parameter-efficient optimization. Extensive benchmarks on the public CWRU dataset and a self-built cylindrical roller bearing dataset demonstrate competitive diagnostic accuracy, improved weak-fault recognition, and stable feature separability, with computational cost analysis further confirming a favorable trade-off among diagnostic robustness, trainable-parameter efficiency, and potential for low-latency online deployment.

Authors

Institutions

Publication Details

Journal
Journal of Computational Design and Engineering
Published
2026-09-15
DOI
https://doi.org/10.1093/jcde/qwag081
Primary Topic
Machine Fault Diagnosis Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
article

WT-STCA-ViT: Window-transform synergistic spectro-temporal channel attention Vision Transformer for robust bearing fault diagnosis

Baochun Lu, W. Huang, Qian Gu, Chaoyang Weng
Journal of Computational Design and Engineering
Machine Fault Diagnosis Techniques
article

WT-STCA-ViT: Window-transform synergistic spectro-temporal channel attention Vision Transformer for robust bearing fault diagnosis

Baochun Lu, W. Huang, Qian Gu, Chaoyang Weng
article en

Abstract

Abstract Reliable bearing fault diagnosis under variable operating conditions and severe noise remains challenging because empirically selected time-frequency front ends may produce degraded representations, while generic attention mechanisms lack explicit sensitivity to fault-related spectral structures. To address these limitations, this study proposes a robust cascaded framework termed window-transform synergistic spectro-temporal channel attention Vision Transformer (WT-STCA-ViT), which integrates a window-enhanced Fourier-based synchrosqueezing transform (FSST) with a spectro-temporal channel attention Vision Transformer (STCA-ViT). Specifically, a parameterized $\alpha {\rm{ - exponential Kaiser - Blackman}}$ $(\alpha {\rm{ - EKB}})$ window family and a task-constrained parameter screening strategy are established to optimize spectral concentration and transient localization, mitigating energy spreading across noisy scenarios. The resulting high-resolution time-frequency maps are encoded using a pretrained Vision Transformer (ViT) backbone and refined via the proposed frequency-axis-structure-aware spectro-temporal channel attention (STCA) mechanism, which generates frequency-dependent channel weights to calibrate band-level features while suppressing noise-dominated and irrelevant feature responses. Furthermore, a lightweight post-Transformer encoder and LoRA adapters are coupled to achieve global token-level refinement and parameter-efficient optimization. Extensive benchmarks on the public CWRU dataset and a self-built cylindrical roller bearing dataset demonstrate competitive diagnostic accuracy, improved weak-fault recognition, and stable feature separability, with computational cost analysis further confirming a favorable trade-off among diagnostic robustness, trainable-parameter efficiency, and potential for low-latency online deployment.

Journal of Computational Design and Engineering
Nanjing University of Science and Technology (CN)
Openalex Percentile: Top 15%
Machine Fault Diagnosis Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.