Deadline-Paced Patrol with Goal-Conditioned Multi-Agent Reinforcement Learning for Sensing-Limited UAV-Assisted Mobile Edge Computing

Computing services can be extended to infrastructure-limited areas through unmanned aerial vehicle (UAV)-assisted mobile edge computing (MEC). However, service provision continues to be challenging when spatially clustered ground users (GUs) are initially unknown and their intermittent workloads expire within finite validity windows. Therefore, conventional trajectory controllers assuming known GU locations and requests are unsuitable under sensing-limited conditions, where out-of-range workloads remain hidden between visits. Partially observable control has been adopted to address these challenges; however, existing frameworks are insufficient, as the discovery of unknown service regions and the repeated revisits required to re-observe hidden demand are not jointly considered. In this paper, a deadline-paced patrol with goal-conditioned multi-agent reinforcement learning (DPP-GCMARL) framework is proposed. In the proposed framework, a rule-based deadline-paced patrol (DPP) layer converts sensing-derived cell memory into deconflicted target cells using staleness normalized by the collection deadline. The assigned targets are then mapped to continuous movement commands by a learned goal-conditioned movement (GCM) layer. Simulation results show that DPP-GCMARL improves the end-to-end completed-workload ratio compared with multi-agent proximal policy optimization (MAPPO). It also increases exploration-coupled fairness and the worst-cluster collection ratio while reducing the mean travel per UAV. These results substantiate the proposed framework’s potential for deadline-constrained MEC service in infrastructure-limited environments.

Authors

Institutions

Publication Details

Journal
Drones
Published
2026-09-14
DOI
https://doi.org/10.3390/drones10090700
Primary Topic
UAV Applications and Optimization
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
article

Deadline-Paced Patrol with Goal-Conditioned Multi-Agent Reinforcement Learning for Sensing-Limited UAV-Assisted Mobile Edge Computing

Joonho Seon, Kyounghun Kim, Young Ghyu Sun, Myeounghyun Lee et al.
Drones
UAV Applications and Optimization
article

Deadline-Paced Patrol with Goal-Conditioned Multi-Agent Reinforcement Learning for Sensing-Limited UAV-Assisted Mobile Edge Computing

Joonho Seon, Kyounghun Kim, Young Ghyu Sun, Myeounghyun Lee, Jeongho Kim, Soo Hyun Kim, Jin Young Kim
article en

Abstract

Computing services can be extended to infrastructure-limited areas through unmanned aerial vehicle (UAV)-assisted mobile edge computing (MEC). However, service provision continues to be challenging when spatially clustered ground users (GUs) are initially unknown and their intermittent workloads expire within finite validity windows. Therefore, conventional trajectory controllers assuming known GU locations and requests are unsuitable under sensing-limited conditions, where out-of-range workloads remain hidden between visits. Partially observable control has been adopted to address these challenges; however, existing frameworks are insufficient, as the discovery of unknown service regions and the repeated revisits required to re-observe hidden demand are not jointly considered. In this paper, a deadline-paced patrol with goal-conditioned multi-agent reinforcement learning (DPP-GCMARL) framework is proposed. In the proposed framework, a rule-based deadline-paced patrol (DPP) layer converts sensing-derived cell memory into deconflicted target cells using staleness normalized by the collection deadline. The assigned targets are then mapped to continuous movement commands by a learned goal-conditioned movement (GCM) layer. Simulation results show that DPP-GCMARL improves the end-to-end completed-workload ratio compared with multi-agent proximal policy optimization (MAPPO). It also increases exploration-coupled fairness and the worst-cluster collection ratio while reducing the mean travel per UAV. These results substantiate the proposed framework’s potential for deadline-constrained MEC service in infrastructure-limited environments.

DronesVol. 10(9)
Kwangwoon University (KR)
Industry, innovation and infrastructure
Openalex Percentile: Top 7%
UAV Applications and Optimization
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.