Predictive Failure Risk Assessment Using Temporal Dependency Modeling in Distributed Computing Environments

Abstract Predicting adverse operational events in distributed computing environments remains challenging because relevant patterns are often distributed across historical system logs and machine-event records. This study investigates temporal feature-based predictive assessment using three supervised prediction tasks and an additional anomaly-label validation task. The experimental methodology combines chronological event aggregation, historical-window feature construction, block-level sequence representation, and machine-specific event-history analysis. Logistic Regression and Random Forest were evaluated using BGL supercomputer logs, HDFS_v1 block sequences, and Google Cluster machine-event records, while OpenStack logs were examined for injected-anomaly identifier validation. For BGL next-minute alert prediction, Logistic Regression achieved an F1-score of 0.3377 and PR-AUC of 0.2982, outperforming Random Forest, which achieved 0.2887 and 0.1729, respectively. For HDFS prefix-based block-outcome classification, Random Forest achieved an F1-score of 0.4481 and PR-AUC of 0.7325, compared with 0.1983 and 0.6350 for Logistic Regression. For Google subsequent machine-removal prediction, Logistic Regression achieved a higher F1-score of 0.9379, whereas Random Forest obtained a higher PR-AUC of 0.9639 compared with 0.9249. The OpenStack validation identified 120 occurrences of four injected-anomaly VM identifiers in the abnormal log and no occurrences in the two normal logs. These findings demonstrate that the effectiveness of temporal operational features and conventional machine-learning classifiers depends on the prediction target, data characteristics, and evaluation metric. The results provide a dataset-specific experimental baseline for operational event-risk assessment rather than direct evidence of independently verified physical failure prediction.

Authors

Institutions

Publication Details

Journal
Research Square
Published
2026-11-11
DOI
https://doi.org/10.21203/rs.3.rs-11679311/v1
Primary Topic
Software System Performance and Reliability
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

Predictive Failure Risk Assessment Using Temporal Dependency Modeling in Distributed Computing Environments

Umma Habiba Sultana
Research Square
Software System Performance and Reliability
preprint

Predictive Failure Risk Assessment Using Temporal Dependency Modeling in Distributed Computing Environments

Umma Habiba Sultana
preprint en

Abstract

Abstract Predicting adverse operational events in distributed computing environments remains challenging because relevant patterns are often distributed across historical system logs and machine-event records. This study investigates temporal feature-based predictive assessment using three supervised prediction tasks and an additional anomaly-label validation task. The experimental methodology combines chronological event aggregation, historical-window feature construction, block-level sequence representation, and machine-specific event-history analysis. Logistic Regression and Random Forest were evaluated using BGL supercomputer logs, HDFS_v1 block sequences, and Google Cluster machine-event records, while OpenStack logs were examined for injected-anomaly identifier validation. For BGL next-minute alert prediction, Logistic Regression achieved an F1-score of 0.3377 and PR-AUC of 0.2982, outperforming Random Forest, which achieved 0.2887 and 0.1729, respectively. For HDFS prefix-based block-outcome classification, Random Forest achieved an F1-score of 0.4481 and PR-AUC of 0.7325, compared with 0.1983 and 0.6350 for Logistic Regression. For Google subsequent machine-removal prediction, Logistic Regression achieved a higher F1-score of 0.9379, whereas Random Forest obtained a higher PR-AUC of 0.9639 compared with 0.9249. The OpenStack validation identified 120 occurrences of four injected-anomaly VM identifiers in the abnormal log and no occurrences in the two normal logs. These findings demonstrate that the effectiveness of temporal operational features and conventional machine-learning classifiers depends on the prediction target, data characteristics, and evaluation metric. The results provide a dataset-specific experimental baseline for operational event-risk assessment rather than direct evidence of independently verified physical failure prediction.

Research Square
Trine University (US)
Software System Performance and Reliability
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon