A Novel Frequency Domain Attention Enhanced CNN-Transformer Network for Remaining Useful Life Prediction

Accurate prediction of the Remaining Useful Life (RUL) is indispensable for maintaining system safety, serving as a cornerstone in the domain of Prognostics and Health Management (PHM). Approaches based on neural networks with manually extracted features are overly dependent on specialized knowledge and underutilize monitoring data, often resulting in low estimation accuracy. This study proposes a frequency domain attention-enhanced CNN-Transformer model for RUL prediction. The proposed method begins with automatic health feature extraction by applying a convolutional neural network layer to the time-series data collected by the sensors, which can reduce the dimensionality of the input health feature vector. Then, the Fourier layer allows feeding frequency domain information to multi-head attention. Finally, the Transformer architecture is utilized to reduce computational costs and improve the accuracy of long-term predictions. In this paper, a turbofan engine is selected as a typical engineering system and the effectiveness and performance of the proposed method are validated using NASA's C-MAPSS dataset. The RMSE of RUL prediction results exhibits better performance compare to traditional methods.

Authors

Institutions

Publication Details

Published
2024-11-20
DOI
https://doi.org/10.1109/icsrs63046.2024.10927455
Citations
1
Primary Topic
Advanced Neural Network Applications
Type
article
Field-Weighted Citation Impact
0.25
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Novel Frequency Domain Attention Enhanced CNN-Transformer Network for Remaining Useful Life Prediction

Bo Sun, Dezhen Yang, Shaoxiong Sun, Yi Ren et al.
1 citations
Advanced Neural Network Applications
0.25
article

A Novel Frequency Domain Attention Enhanced CNN-Transformer Network for Remaining Useful Life Prediction

Bo Sun, Dezhen Yang, Shaoxiong Sun, Yi Ren, Cheng Qian, Quan Xia, Fusheng Jiang
article en
1 citations

Abstract

Accurate prediction of the Remaining Useful Life (RUL) is indispensable for maintaining system safety, serving as a cornerstone in the domain of Prognostics and Health Management (PHM). Approaches based on neural networks with manually extracted features are overly dependent on specialized knowledge and underutilize monitoring data, often resulting in low estimation accuracy. This study proposes a frequency domain attention-enhanced CNN-Transformer model for RUL prediction. The proposed method begins with automatic health feature extraction by applying a convolutional neural network layer to the time-series data collected by the sensors, which can reduce the dimensionality of the input health feature vector. Then, the Fourier layer allows feeding frequency domain information to multi-head attention. Finally, the Transformer architecture is utilized to reduce computational costs and improve the accuracy of long-term predictions. In this paper, a turbofan engine is selected as a typical engineering system and the effectiveness and performance of the proposed method are validated using NASA's C-MAPSS dataset. The RMSE of RUL prediction results exhibits better performance compare to traditional methods.

Beihang University (CN)
Zero hunger
Openalex Percentile: Top 41%
Advanced Neural Network Applications
0.25
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

A Novel Frequency Domain Attention Enhanced CNN-Transformer Network for Remaining Useful Life Prediction — Bo Sun, Dezhen Yang, et al. · (2024) | TGRS Research Map | TGRS