Efficient retraining of machine learning algorithms in cloud management systems

Cloud management systems performing capacity autoscaling, application orchestration, server consolidation, and service differentiation increasingly rely on machine learning (ML) models for predictive decision-making. However, changes in user behavior, software updates, and hardware upgrades cause monitoring data to deviate from the training distribution, leading to model performance degradation. This phenomenon—known as concept drift poses a significant challenge to maintaining prediction accuracy in dynamic cloud environments. In this work, we propose a hybrid concept drift detection approach that combines statistical data monitoring with model performance metrics to inform efficient model retraining. The proposed method minimizes false positives, reduces adaptation delays, and avoids unnecessary retraining during stable periods. We conduct extensive experiments on both synthetic and real-world cloud workload datasets collected from multiple data centers, evaluating the hybrid approach against five established drift detection algorithms. To ensure statistical rigor, all experiments are repeated ten times, and the results are reported with 95% confidence intervals and significance tests. The results show that our proposed approach and implemented methods improve drift detection efficiency by eliminating unnecessary retraining and lead to more than 60% improvements over the baseline prediction accuracy. We Edited the abstract and removed the inconsistencies

Authors

Institutions

Publication Details

Journal
Future Generation Computer Systems
Published
2026-03-11
DOI
https://doi.org/10.1016/j.future.2026.108478
Primary Topic
Data Stream Mining Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Efficient retraining of machine learning algorithms in cloud management systems

Paul Townend, Lidia Kidane, Thijs Metsch, Erik Elmroth
Future Generation Computer Systems
Data Stream Mining Techniques
article

Efficient retraining of machine learning algorithms in cloud management systems

Paul Townend, Lidia Kidane, Thijs Metsch, Erik Elmroth
article en

Abstract

Cloud management systems performing capacity autoscaling, application orchestration, server consolidation, and service differentiation increasingly rely on machine learning (ML) models for predictive decision-making. However, changes in user behavior, software updates, and hardware upgrades cause monitoring data to deviate from the training distribution, leading to model performance degradation. This phenomenon—known as concept drift poses a significant challenge to maintaining prediction accuracy in dynamic cloud environments. In this work, we propose a hybrid concept drift detection approach that combines statistical data monitoring with model performance metrics to inform efficient model retraining. The proposed method minimizes false positives, reduces adaptation delays, and avoids unnecessary retraining during stable periods. We conduct extensive experiments on both synthetic and real-world cloud workload datasets collected from multiple data centers, evaluating the hybrid approach against five established drift detection algorithms. To ensure statistical rigor, all experiments are repeated ten times, and the results are reported with 95% confidence intervals and significance tests. The results show that our proposed approach and implemented methods improve drift detection efficiency by eliminating unnecessary retraining and lead to more than 60% improvements over the baseline prediction accuracy. We Edited the abstract and removed the inconsistencies

Future Generation Computer SystemsVol. 182
Intel (Germany) (DE), Umeå University (SE)
Peace, Justice and strong institutions
Openalex Percentile: Top 29%
Data Stream Mining Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.