An intelligent fault diagnosis method based on L2 regularization and deep transfer LSTM

With the advancement of the modern manufacturing industry, fault diagnosis has become increasingly critical, especially for rotating machines operating under varying working conditions (WCs). While numerous deep learning methods have been proposed, they often require extensive labeled data for training, which is challenging due to data scarcity and limited label availability. Moreover, their performance tends to deteriorate when applied to different domains. To overcome these issues, this paper introduces an intelligent fault diagnosis technique that leverages L2 regularization and deep transfer learning with LSTM networks, capable of adapting to different environments. The approach involves a pre-training phase followed by fine-tuning, where knowledge from the pre-trained model is transferred and adjusted for new working conditions. The study finds that fine-tuning all layers of the model results in minimal variation, with accuracy within 0.05%, indicating high consistency. In contrast, fine-tuning only the final classification layers shows a broader range of accuracies, approximately within 6%, indicating moderate consistency—a conclusion further supported by t-SNE feature visualization.

Authors

Institutions

Publication Details

Published
2024-12-15
DOI
https://doi.org/10.1109/ieem62345.2024.10857194
Citations
3
Primary Topic
Advanced Decision-Making Techniques
Type
article
Field-Weighted Citation Impact
1.56

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

An intelligent fault diagnosis method based on L2 regularization and deep transfer LSTM

C.K.M. Lee, K. L. Keung, Misbah Iqbal
3 citations
Advanced Decision-Making Techniques
1.56
article

An intelligent fault diagnosis method based on L2 regularization and deep transfer LSTM

C.K.M. Lee, K. L. Keung, Misbah Iqbal
article en
3 citations

Abstract

With the advancement of the modern manufacturing industry, fault diagnosis has become increasingly critical, especially for rotating machines operating under varying working conditions (WCs). While numerous deep learning methods have been proposed, they often require extensive labeled data for training, which is challenging due to data scarcity and limited label availability. Moreover, their performance tends to deteriorate when applied to different domains. To overcome these issues, this paper introduces an intelligent fault diagnosis technique that leverages L2 regularization and deep transfer learning with LSTM networks, capable of adapting to different environments. The approach involves a pre-training phase followed by fine-tuning, where knowledge from the pre-trained model is transferred and adjusted for new working conditions. The study finds that fine-tuning all layers of the model results in minimal variation, with accuracy within 0.05%, indicating high consistency. In contrast, fine-tuning only the final classification layers shows a broader range of accuracies, approximately within 6%, indicating moderate consistency—a conclusion further supported by t-SNE feature visualization.

Hong Kong Polytechnic University (HK)
Hong Kong Polytechnic University
Climate action
Openalex Percentile: Top 11%
Advanced Decision-Making Techniques
1.56
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.