Optimizing Resource Allocation in Cloud Environments Using Reinforcement Learning

Traditional cloud resource allocation techniques, which rely on static, rule-based systems, are inefficient and lead to greater costs and lower performance due to issues like over- and under-provisioning. The study presents a novel way to dynamically optimize resource allocation in real-time using reinforcement learning (RL) algorithms, such as Deep Q-Networks (DQN), Proximal Policy Optimization (PPO), and Actor-Critic approaches. The RL-based system overcomes the limitations of traditional techniques by adjusting to shifting workloads and learning from the past. The average resource usage efficiencies of DQN, PPO, and Actor-Critic are 85.7%, 88.1%, and 87.4%, respectively, compared to 72.3% for traditional systems. The results demonstrate that RL approaches perform much better than traditional systems. The RL techniques also enhanced system performance and decreased expenses by as much as 29.4%; PPO had the highest results in response time (270 ms), throughput (190 requests/second), and user satisfaction (88%).

Authors

Institutions

Publication Details

Published
2024-12-12
DOI
https://doi.org/10.1109/icses63760.2024.10910650
Citations
6
Primary Topic
Cloud Computing and Resource Management
Type
article
Field-Weighted Citation Impact
4.67
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Optimizing Resource Allocation in Cloud Environments Using Reinforcement Learning

H. Anwer Basha, P. Malathi, L. Priya, E. Dilipkumar et al.
6 citations
Cloud Computing and Resource Management
4.67
article

Optimizing Resource Allocation in Cloud Environments Using Reinforcement Learning

H. Anwer Basha, P. Malathi, L. Priya, E. Dilipkumar, J. Rajasubha, A S Yokesh.
article en
6 citations

Abstract

Traditional cloud resource allocation techniques, which rely on static, rule-based systems, are inefficient and lead to greater costs and lower performance due to issues like over- and under-provisioning. The study presents a novel way to dynamically optimize resource allocation in real-time using reinforcement learning (RL) algorithms, such as Deep Q-Networks (DQN), Proximal Policy Optimization (PPO), and Actor-Critic approaches. The RL-based system overcomes the limitations of traditional techniques by adjusting to shifting workloads and learning from the past. The average resource usage efficiencies of DQN, PPO, and Actor-Critic are 85.7%, 88.1%, and 87.4%, respectively, compared to 72.3% for traditional systems. The results demonstrate that RL approaches perform much better than traditional systems. The RL techniques also enhanced system performance and decreased expenses by as much as 29.4%; PPO had the highest results in response time (270 ms), throughput (190 requests/second), and user satisfaction (88%).

Dhanalakshmi Srinivasan Group of Institutions (IN), Saveetha University (IN)
Openalex Percentile: Top 5%
Cloud Computing and Resource Management
4.67
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.