Automatic analysis and anomaly detection technology of intelligent operation and maintenance log integrated with natural language processing

The traditional manual log analysis approach is increasingly inadequate for meeting the demands of efficient and accurate operation and maintenance. To address this challenge, this paper proposes an intelligent log analysis framework capable of automatically processing large-scale log data, accurately identifying anomalies, and providing timely and effective decision-making support for operation and maintenance teams. The proposed system architecture comprises five core modules: log acquisition, data preprocessing, natural language processing (NLP)-based feature extraction, anomaly detection, and result visualization and alerting. By leveraging NLP techniques, the system can deeply interpret and extract valuable information from log texts, construct log template vectors, and support precise anomaly detection. For anomaly detection, this study employs deep learning models, specifically long short-term memory (LSTM) networks, to automatically learn complex patterns in log data and accurately identify anomalous events. Experimental results demonstrate the superior performance of the LSTM model in log classification tasks, achieving an accuracy of 97.5%, with precision, recall, and F1 scores of 80.0%, 75.0%, and 77.4%, respectively, significantly outperforming traditional statistical anomaly detection methods. This research highlights the effectiveness of integrating NLP and LSTM-based methods for intelligent automated log analysis and anomaly detection. The proposed approach not only enhances operational efficiency but also improves system stability, offering a robust solution for modern operation and maintenance challenges.

Authors

Institutions

Publication Details

Published
2025-05-09
DOI
https://doi.org/10.1117/12.3067399
Primary Topic
Advanced Data Processing Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Automatic analysis and anomaly detection technology of intelligent operation and maintenance log integrated with natural language processing

Zepeng Wen, Shuai Xu, Han Wang, Yakun Zhang et al.
Advanced Data Processing Techniques
article

Automatic analysis and anomaly detection technology of intelligent operation and maintenance log integrated with natural language processing

Zepeng Wen, Shuai Xu, Han Wang, Yakun Zhang, Ziyang Meng
article en

Abstract

The traditional manual log analysis approach is increasingly inadequate for meeting the demands of efficient and accurate operation and maintenance. To address this challenge, this paper proposes an intelligent log analysis framework capable of automatically processing large-scale log data, accurately identifying anomalies, and providing timely and effective decision-making support for operation and maintenance teams. The proposed system architecture comprises five core modules: log acquisition, data preprocessing, natural language processing (NLP)-based feature extraction, anomaly detection, and result visualization and alerting. By leveraging NLP techniques, the system can deeply interpret and extract valuable information from log texts, construct log template vectors, and support precise anomaly detection. For anomaly detection, this study employs deep learning models, specifically long short-term memory (LSTM) networks, to automatically learn complex patterns in log data and accurately identify anomalous events. Experimental results demonstrate the superior performance of the LSTM model in log classification tasks, achieving an accuracy of 97.5%, with precision, recall, and F1 scores of 80.0%, 75.0%, and 77.4%, respectively, significantly outperforming traditional statistical anomaly detection methods. This research highlights the effectiveness of integrating NLP and LSTM-based methods for intelligent automated log analysis and anomaly detection. The proposed approach not only enhances operational efficiency but also improves system stability, offering a robust solution for modern operation and maintenance challenges.

China Academy of Engineering Physics (CN)
Quality Education
Openalex Percentile: Top 89%
Advanced Data Processing Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Automatic analysis and anomaly detection technology of intelligent operation and maintenance log integrated with natural language processing — Zepeng Wen, Shuai Xu, et al. · (2025) | TGRS Research Map | TGRS