Log anomaly detection and diagnosis method based on deep learning

In order to improve the accuracy of log anomaly detection and diagnostic effectiveness, this paper proposes a deep learning-based log anomaly detection and diagnosis method. Firstly, analyse the log data and obtain the corresponding relationship between the log keys and log parameters. Secondly, using deep learning to capture association features, a convolutional neural network bidirectional long short-term memory (CNN-BiLSTM) deep learning model is constructed. Finally, learning context sequence feature information from both positive and negative directions through bidirectional input, and implementing log anomaly detection and diagnosis based on the results of context sequence feature information. The experimental results show that the accuracy of log anomaly detection in this method can reach 98.6%, the time required for log anomaly detection can reach 1.1 s, and the recall rate for log anomaly detection is 96.8%. The log anomaly detection effect is good.

Authors

Institutions

Publication Details

Journal
International Journal of Data Mining and Bioinformatics
Published
2024-12-03
DOI
https://doi.org/10.1504/ijdmb.2025.142978
Citations
1
Primary Topic
Anomaly Detection Techniques and Applications
Type
article
Field-Weighted Citation Impact
0.35
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Log anomaly detection and diagnosis method based on deep learning

Dejun Mu, Zhiwei Liu, Xiaoyu Li
1 citations
International Journal of Data Mining and Bioinformatics
Anomaly Detection Techniques and Applications
0.35
article

Log anomaly detection and diagnosis method based on deep learning

Dejun Mu, Zhiwei Liu, Xiaoyu Li
article en
1 citations

Abstract

In order to improve the accuracy of log anomaly detection and diagnostic effectiveness, this paper proposes a deep learning-based log anomaly detection and diagnosis method. Firstly, analyse the log data and obtain the corresponding relationship between the log keys and log parameters. Secondly, using deep learning to capture association features, a convolutional neural network bidirectional long short-term memory (CNN-BiLSTM) deep learning model is constructed. Finally, learning context sequence feature information from both positive and negative directions through bidirectional input, and implementing log anomaly detection and diagnosis based on the results of context sequence feature information. The experimental results show that the accuracy of log anomaly detection in this method can reach 98.6%, the time required for log anomaly detection can reach 1.1 s, and the recall rate for log anomaly detection is 96.8%. The log anomaly detection effect is good.

International Journal of Data Mining and BioinformaticsVol. 29(1/2)
Northwestern Polytechnical University (CN)
Openalex Percentile: Top 31%
Anomaly Detection Techniques and Applications
0.35
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.