ВЫЯВЛЕНИЕ АНОМАЛИЙ В ДАННЫХ МОНИТОРИНГА ПРОИЗВОДИТЕЛЬНОСТИ С ИСПОЛЬЗОВАНИЕМ АЛГОРИТМА ISOLATION FOREST: ВОЗМОЖНОСТИ И ОГРАНИЧЕНИЯ

This paper explores the application of the Isolation Forest algorithm for detecting anomalies in performance monitoring data of a SaaS project’s servers. The main hypothesis suggests that the algorithm can identify early signs of performance degradation and potential failures by analyzing basic metrics such as CPU load, memory usage, network traffic, and disk space. Two approaches were tested: analyzing each metric separately and aggregating them into a single indicator to assess the overall system state. The results showed that Isolation Forest demonstrates high sensitivity to sudden changes in metrics, leading to a significant number of false positives. This issue is particularly relevant when dealing with short-term metric spikes that do not necessarily indicate real system problems. The paper discusses the limitations of this approach, including the need for fine-tuning hyperparameters, and suggests possible solutions for improving anomaly detection accuracy, such as preprocessing data and combining it with other methods. This study highlights the importance of advanced machine learning techniques in server performance monitoring, especially in conditions with limited metrics, typical of closed-source systems.

Authors

Institutions

Publication Details

Journal
Ķ. Žu̇banov atyndaġy Aķtôbe ôṇìrlìk memlekettìk universitetìnìṇ habaršysy.
Published
2024-12-31
DOI
https://doi.org/10.70239/arsu.2024.t78.n4.02
Primary Topic
Software System Performance and Reliability
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

ВЫЯВЛЕНИЕ АНОМАЛИЙ В ДАННЫХ МОНИТОРИНГА ПРОИЗВОДИТЕЛЬНОСТИ С ИСПОЛЬЗОВАНИЕМ АЛГОРИТМА ISOLATION FOREST: ВОЗМОЖНОСТИ И ОГРАНИЧЕНИЯ

Meng Lon Iu, Adilzhan Kereyev
Ķ. Žu̇banov atyndaġy Aķtôbe ôṇìrlìk memlekettìk universitetìnìṇ habaršysy.
Software System Performance and Reliability
article

ВЫЯВЛЕНИЕ АНОМАЛИЙ В ДАННЫХ МОНИТОРИНГА ПРОИЗВОДИТЕЛЬНОСТИ С ИСПОЛЬЗОВАНИЕМ АЛГОРИТМА ISOLATION FOREST: ВОЗМОЖНОСТИ И ОГРАНИЧЕНИЯ

Meng Lon Iu, Adilzhan Kereyev
article en

Abstract

This paper explores the application of the Isolation Forest algorithm for detecting anomalies in performance monitoring data of a SaaS project’s servers. The main hypothesis suggests that the algorithm can identify early signs of performance degradation and potential failures by analyzing basic metrics such as CPU load, memory usage, network traffic, and disk space. Two approaches were tested: analyzing each metric separately and aggregating them into a single indicator to assess the overall system state. The results showed that Isolation Forest demonstrates high sensitivity to sudden changes in metrics, leading to a significant number of false positives. This issue is particularly relevant when dealing with short-term metric spikes that do not necessarily indicate real system problems. The paper discusses the limitations of this approach, including the need for fine-tuning hyperparameters, and suggests possible solutions for improving anomaly detection accuracy, such as preprocessing data and combining it with other methods. This study highlights the importance of advanced machine learning techniques in server performance monitoring, especially in conditions with limited metrics, typical of closed-source systems.

Ķ. Žu̇banov atyndaġy Aķtôbe ôṇìrlìk memlekettìk universitetìnìṇ habaršysy.Vol. 78(4)
Microsoft (United States) (US)
Life in Land
Openalex Percentile: Top 71%
Software System Performance and Reliability
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.