Phoneme-inspired acoustic frame embedded lightweight transformer for rolling bearing fault diagnosis

Acoustic-based fault diagnosis has gained increasing attention due to its flexibility and applicability under diverse operating conditions. Recent studies have demonstrated that Transformer-based architectures exhibit remarkable capability in modeling long-range temporal dependencies, so they are particularly effective for complex time series representation and analysis. However, applying Transformers to acoustic fault diagnosis faces the following critical challenges. The primary hurdle lies in discriminating short-duration nonstationary acoustic features amidst complex environmental interference, Simultaneously, how to ensure model diagnostic performance under limited computing resources is a challenge. Inspired by the phoneme processing paradigm where continuous speech is discretized into meaningful units, this paper proposes a lightweight acoustic segment-frame embedded Transformer, termed ASFE-Transformer, to address these issues effectively. First, an Analytic Amplitude-Phase Representation Module is introduced to derive physically meaningful representations, ensuring that the instantaneous evolution characteristics of multidimensional acoustic signals are faithfully retained. Second, an Acoustic Frame Embedding Module is developed to aggregate continuous analytic samples into a single token during the embedding stage. This strategy generates a more efficient token sequence and explicitly enhances the discriminability of transient fault cues while substantially reducing the computational burden. Third, the feed-forward network of the Transformer is redesigned by proposing a novel Swish-Depthwise Gated Linear Unit. By embedding a lightweight depth-wise convolution within the Swish-activated gating mechanism, this module introduces local contextual awareness into the encoder. Comprehensive experiments on two bearing acoustic datasets verify that the proposed framework delivers robust diagnostic performance with a lightweight design and highlight its strong potential for real-world industrial deployment.

Authors

Institutions

Publication Details

Journal
Mechanical Systems and Signal Processing
Published
2026-02-16
DOI
https://doi.org/10.1016/j.ymssp.2026.114030
Primary Topic
Machine Fault Diagnosis Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Phoneme-inspired acoustic frame embedded lightweight transformer for rolling bearing fault diagnosis

Linhao Peng, Lv Zhongliang, Yongbin Liu, Fang Liu et al.
Mechanical Systems and Signal Processing
Machine Fault Diagnosis Techniques
article

Phoneme-inspired acoustic frame embedded lightweight transformer for rolling bearing fault diagnosis

Linhao Peng, Lv Zhongliang, Yongbin Liu, Fang Liu, Min Xia
article en

Abstract

Acoustic-based fault diagnosis has gained increasing attention due to its flexibility and applicability under diverse operating conditions. Recent studies have demonstrated that Transformer-based architectures exhibit remarkable capability in modeling long-range temporal dependencies, so they are particularly effective for complex time series representation and analysis. However, applying Transformers to acoustic fault diagnosis faces the following critical challenges. The primary hurdle lies in discriminating short-duration nonstationary acoustic features amidst complex environmental interference, Simultaneously, how to ensure model diagnostic performance under limited computing resources is a challenge. Inspired by the phoneme processing paradigm where continuous speech is discretized into meaningful units, this paper proposes a lightweight acoustic segment-frame embedded Transformer, termed ASFE-Transformer, to address these issues effectively. First, an Analytic Amplitude-Phase Representation Module is introduced to derive physically meaningful representations, ensuring that the instantaneous evolution characteristics of multidimensional acoustic signals are faithfully retained. Second, an Acoustic Frame Embedding Module is developed to aggregate continuous analytic samples into a single token during the embedding stage. This strategy generates a more efficient token sequence and explicitly enhances the discriminability of transient fault cues while substantially reducing the computational burden. Third, the feed-forward network of the Transformer is redesigned by proposing a novel Swish-Depthwise Gated Linear Unit. By embedding a lightweight depth-wise convolution within the Swish-activated gating mechanism, this module introduces local contextual awareness into the encoder. Comprehensive experiments on two bearing acoustic datasets verify that the proposed framework delivers robust diagnostic performance with a lightweight design and highlight its strong potential for real-world industrial deployment.

Mechanical Systems and Signal ProcessingVol. 248
Western University (CA), Anhui University (CN), Chongqing University of Science and Technology (CN)
Reduced inequalities
Openalex Percentile: Top 55%
Machine Fault Diagnosis Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.