Adaptive Task Scheduling Under Dynamic Edge System Loads: A Deep Reinforcement Learning Approach

ABSTRACT Edge computing systems are in great need of task scheduling due to resource constraints. However, existing scheduling algorithms typically optimize single objectives and lack adaptability to varying system conditions, failing to balance response time minimization during low workloads with queue balance maintenance under high workloads. This paper proposes an adaptive task scheduling algorithm based on Soft Actor‐Critic (SAC) with a novel workload‐aware reward mechanism, which automatically transitions between response time optimization and queue balance prioritization according to system load conditions. The whole scheduling problem is modeled as a Markov Decision Process (MDP), and a sliding window‐based performance evaluation framework is introduced to provide robust system assessment. Extensive experiments across multiple scenarios demonstrate that our method consistently achieves optimal response time across varying workload conditions, significantly outperforming traditional scheduling algorithms, while maintaining effective queue balance comparable to load‐based approaches under high workload scenarios.

Authors

Institutions

Publication Details

Journal
Concurrency and Computation Practice and Experience
Published
2025-11-04
DOI
https://doi.org/10.1002/cpe.70416
Primary Topic
IoT and Edge/Fog Computing
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Adaptive Task Scheduling Under Dynamic Edge System Loads: A Deep Reinforcement Learning Approach

Jin Xu, Guisheng Fan, Hengrun Zhang, Huiqun Yu
Concurrency and Computation Practice and Experience
IoT and Edge/Fog Computing
article

Adaptive Task Scheduling Under Dynamic Edge System Loads: A Deep Reinforcement Learning Approach

Jin Xu, Guisheng Fan, Hengrun Zhang, Huiqun Yu
article en

Abstract

ABSTRACT Edge computing systems are in great need of task scheduling due to resource constraints. However, existing scheduling algorithms typically optimize single objectives and lack adaptability to varying system conditions, failing to balance response time minimization during low workloads with queue balance maintenance under high workloads. This paper proposes an adaptive task scheduling algorithm based on Soft Actor‐Critic (SAC) with a novel workload‐aware reward mechanism, which automatically transitions between response time optimization and queue balance prioritization according to system load conditions. The whole scheduling problem is modeled as a Markov Decision Process (MDP), and a sliding window‐based performance evaluation framework is introduced to provide robust system assessment. Extensive experiments across multiple scenarios demonstrate that our method consistently achieves optimal response time across varying workload conditions, significantly outperforming traditional scheduling algorithms, while maintaining effective queue balance comparable to load‐based approaches under high workload scenarios.

Concurrency and Computation Practice and ExperienceVol. 37(27-28)
East China University of Science and Technology (CN)
Openalex Percentile: Top 62%
IoT and Edge/Fog Computing
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Adaptive Task Scheduling Under Dynamic Edge System Loads: A Deep Reinforcement Learning Approach — Jin Xu, Guisheng Fan, et al. · Concurrency and Computation Practice and Experience (2025) | TGRS Research Map | TGRS