Unsupervised Log Sequence Anomaly Detection via Deep Embedded Fuzzy Clustering with FGM-VAE and LSTM
This paper presents FVLL, a novel unsupervised log sequence anomaly detection method that combines FGM-VAE and LSTM within a deeply embedded fuzzy clustering framework. Unlike existing methods, FVLL eliminates reliance on labeled data during both training and detection. It learns an end-to-end anomaly detection model using unlabeled log data, consisting of a deep feature extraction model and a fuzzy clustering model, optimized based on reconstruction and clustering losses. FVLL classifies log sequences into normal, abnormal, and fuzzy categories, further distinguishing the fuzzy class using cosine similarity. Experimental results on public datasets (HDFS and BGL) demonstrate that FVLL outperforms existing methods in detecting log sequence anomalies.
Authors
- Zhiying Cao
- Peipeng Wang (ORCID: https://orcid.org/0009-0003-9945-1177)
- Yutian Chen (ORCID: https://orcid.org/0000-0001-8008-9014)
- Xiuguo Zhang (ORCID: https://orcid.org/0000-0003-0204-0295)
Institutions
- Dalian Maritime University (CN)
Publication Details
- Published
- 2024-12-06
- DOI
- https://doi.org/10.1109/iaecst64597.2024.11118135
- Primary Topic
- Anomaly Detection Techniques and Applications
- Type
- article
- Field-Weighted Citation Impact
- 0.00