Reinforcement Learning for Auto-Scaling and Cost Optimization in Multi-Cloud

Auto-scaling decides how much capacity to provision for a workload and — in a multi-cloud setting — where to place it across providers, regions, and pricing models. Traditional threshold and forecast-based autoscalers react with fixed rules and tend to over-provision, wasting money, or under-provision, breaching service-level agreements (SLAs). This article presents reinforcement learning (RL) as a principled alternative: an agent that learns a cost-aware, SLA-constrained scaling and placement policy directly from interaction with the environment. We formalize multi-cloud auto-scaling as a Markov decision process, design a composite reward that trades resource cost against SLA penalties, utilization, and scaling churn, and extend the action space to multi-cloud placement — choosing provider, region, and on-demand versus spot capacity to exploit cross-cloud price differences and spot discounts while respecting interruption risk and data-residency constraints. We review the dominant algorithms (DQN, PPO, DDPG), discuss safe exploration via bootstrapping from a conventional autoscaler, and give illustrative results consistent with the published literature, where RL autoscalers report on the order of 20% cost savings and improved tail latency relative to threshold-based baselines. Public technical sources are cited throughout.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-08-03
DOI
https://doi.org/10.5281/zenodo.21770367
Primary Topic
Cloud Computing and Resource Management
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Reinforcement Learning for Auto-Scaling and Cost Optimization in Multi-Cloud

Sushma Sunkollu Nagaraj
Zenodo (CERN European Organization for Nuclear Research)
Cloud Computing and Resource Management
article

Reinforcement Learning for Auto-Scaling and Cost Optimization in Multi-Cloud

Sushma Sunkollu Nagaraj
article en

Abstract

Auto-scaling decides how much capacity to provision for a workload and — in a multi-cloud setting — where to place it across providers, regions, and pricing models. Traditional threshold and forecast-based autoscalers react with fixed rules and tend to over-provision, wasting money, or under-provision, breaching service-level agreements (SLAs). This article presents reinforcement learning (RL) as a principled alternative: an agent that learns a cost-aware, SLA-constrained scaling and placement policy directly from interaction with the environment. We formalize multi-cloud auto-scaling as a Markov decision process, design a composite reward that trades resource cost against SLA penalties, utilization, and scaling churn, and extend the action space to multi-cloud placement — choosing provider, region, and on-demand versus spot capacity to exploit cross-cloud price differences and spot discounts while respecting interruption risk and data-residency constraints. We review the dominant algorithms (DQN, PPO, DDPG), discuss safe exploration via bootstrapping from a conventional autoscaler, and give illustrative results consistent with the published literature, where RL autoscalers report on the order of 20% cost savings and improved tail latency relative to threshold-based baselines. Public technical sources are cited throughout.

Zenodo (CERN European Organization for Nuclear Research)
Openalex Percentile: Top 4%
Cloud Computing and Resource Management
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.