Cross-Domain DRL Agents for Efficient Job Placement in the Cloud-Edge Continuum

The growing computational demands of modern applications call for resource management strategies that effectively utilize the strengths of both cloud and edge computing. Deep Reinforcement Learning (DRL) has shown great promise in addressing these challenges, offering advanced decision-making capabilities that optimize resource allocation and system performance. However, deploying DRL agents in cloud-edge continuum infrastructures remains a significant challenge due to their dependence on infrastructure-specific state-action representations. This paper presents a novel architectural framework for DRL agents that incorporates feature extraction and adaptation mechanisms to enable their seamless operation across diverse environments. By transforming state features into an infrastructure-agnostic representation, our approach reduces the need for extensive retraining when system configurations change. Experimental results show that our method outperforms both a heuristic method and a DRL baseline algorithm while achieving faster convergence when infrastructure and workloads change. This work is an important step forward in developing transferable and adaptable DRL solutions for real-world cloud-edge resource management challenges.

Authors

Institutions

Publication Details

Published
2025-03-30
DOI
https://doi.org/10.1145/3721146.3721934
Citations
3
Primary Topic
Cloud Computing and Resource Management
Type
article
Field-Weighted Citation Impact
9.74

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Cross-Domain DRL Agents for Efficient Job Placement in the Cloud-Edge Continuum

Spyros Lalis, Sokol Kosta, Dimitris Chatzopoulos, Theodoros Aslanidis
3 citations
Cloud Computing and Resource Management
9.74
article

Cross-Domain DRL Agents for Efficient Job Placement in the Cloud-Edge Continuum

Spyros Lalis, Sokol Kosta, Dimitris Chatzopoulos, Theodoros Aslanidis
article en
3 citations

Abstract

The growing computational demands of modern applications call for resource management strategies that effectively utilize the strengths of both cloud and edge computing. Deep Reinforcement Learning (DRL) has shown great promise in addressing these challenges, offering advanced decision-making capabilities that optimize resource allocation and system performance. However, deploying DRL agents in cloud-edge continuum infrastructures remains a significant challenge due to their dependence on infrastructure-specific state-action representations. This paper presents a novel architectural framework for DRL agents that incorporates feature extraction and adaptation mechanisms to enable their seamless operation across diverse environments. By transforming state features into an infrastructure-agnostic representation, our approach reduces the need for extensive retraining when system configurations change. Experimental results show that our method outperforms both a heuristic method and a DRL baseline algorithm while achieving faster convergence when infrastructure and workloads change. This work is an important step forward in developing transferable and adaptable DRL solutions for real-world cloud-edge resource management challenges.

University College Dublin (IE), University of Thessaly (GR), Aalborg University (DK)
Innovationsfonden, European Commission, HORIZON EUROPE Framework Programme
Decent work and economic growth
Openalex Percentile: Top 3%
Cloud Computing and Resource Management
9.74
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.