Log Anomaly Detection Method Based On Multi-Feature Graph Embedding

Modern software systems generate a large amount of logs during runtime, which reflect the system's operational status. The reliability of system services relies on automatic log anomaly detection. Researchers have proposed anomaly detection methods based on log features and sequence structures. However, existing methods, while utilizing various log features and structured information, still do not exploit the implicit feature information of logs and fail to fully capture the structural information of log sequences when fusing contextual event features of logs. Therefore, we propose an anomaly detection method based on multi-feature graph embedding, LogMFG, which fully extracts explicit, implicit, parameter, and semantic features of logs using a defined multi-feature extraction method for log messages. Log messages are represented as graph nodes with multiple feature attributes. Finally, GTN (Graph Transformer Network) is utilized to effectively fuse multi-feature information of log events with the global structure of log sequences for anomaly detection in log sequences. Experimental results on public datasets HDFS and BGL show that LogMFG outperforms eight log anomaly detection methods, with an anomaly log detection F1 score higher than 0.9992, and surpasses the state-of-the-art LogGT algorithm in offline log anomaly detection.

Authors

Institutions

Publication Details

Published
2024-12-27
DOI
https://doi.org/10.1109/eiecc64539.2024.10929241
Primary Topic
Software System Performance and Reliability
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Log Anomaly Detection Method Based On Multi-Feature Graph Embedding

Le Li, Jizhao Liu
Software System Performance and Reliability
article

Log Anomaly Detection Method Based On Multi-Feature Graph Embedding

Le Li, Jizhao Liu
article en

Abstract

Modern software systems generate a large amount of logs during runtime, which reflect the system's operational status. The reliability of system services relies on automatic log anomaly detection. Researchers have proposed anomaly detection methods based on log features and sequence structures. However, existing methods, while utilizing various log features and structured information, still do not exploit the implicit feature information of logs and fail to fully capture the structural information of log sequences when fusing contextual event features of logs. Therefore, we propose an anomaly detection method based on multi-feature graph embedding, LogMFG, which fully extracts explicit, implicit, parameter, and semantic features of logs using a defined multi-feature extraction method for log messages. Log messages are represented as graph nodes with multiple feature attributes. Finally, GTN (Graph Transformer Network) is utilized to effectively fuse multi-feature information of log events with the global structure of log sequences for anomaly detection in log sequences. Experimental results on public datasets HDFS and BGL show that LogMFG outperforms eight log anomaly detection methods, with an anomaly log detection F1 score higher than 0.9992, and surpasses the state-of-the-art LogGT algorithm in offline log anomaly detection.

Zhongyuan University of Technology (CN)
Openalex Percentile: Top 66%
Software System Performance and Reliability
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Log Anomaly Detection Method Based On Multi-Feature Graph Embedding — Le Li, Jizhao Liu · (2024) | TGRS Research Map | TGRS