Cooperative UAV Swarm Data Collection: Global Coverage Memory and Neuro-Physical Action Control with FSCM-MAPPO

The increasing deployment of Unmanned Aerial Vehicle (UAV) swarms in Internet of Things (IoT) systems enables large-scale cooperative data collection. However, cooperative data collection by UAV swarms remains difficult due to sparse rewards, redundant exploration, inefficient coordination, and the need to refine discrete policy proposals before environment execution. To address these limitations, this paper studies cooperative UAV target collection in randomized simulated environments with observable target and obstacle locations and proposes a Full Spatial Coverage Memory Multi-Agent Proximal Policy Optimization (FSCM-MAPPO), a cooperative data collection algorithm integrating global perception grid with dynamic shared memory, a dense reward shaping mechanism, and a neuro-physical hybrid action controller. Specifically, a global perception grid with dynamic shared memory provides explicit spatial memory and coverage awareness, in which the global coverage information is complementary to each UAV’s local observation, thereby alleviating reward sparsity and redundant search. A neuro-physical hybrid action controller refines policy outputs through local geometric screening, velocity-based intent refinement, and discrete action selection. In an enhanced Multi-Agent Particle Environment with dynamic energy constraints, FSCM-MAPPO attains 71.80±9.73% full-task success and 95.77±1.67% target collection across five independent seeds under deterministic action selection, outperforming the tested MARL baselines. Ablations further show that coverage memory improves visitation and reduces repeated visits, while dense shaping and hybrid control aid task completion. Furthermore, fixed-policy comparisons reveal that hybrid control reduces accumulated contact exposure but increases contact-entry events, indicating a trade-off between task completion and contact behavior.

Authors

Institutions

Publication Details

Journal
Symmetry
Published
2026-10-29
DOI
https://doi.org/10.3390/sym18111814
Primary Topic
Reinforcement Learning in Robotics
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Cooperative UAV Swarm Data Collection: Global Coverage Memory and Neuro-Physical Action Control with FSCM-MAPPO

Ziyi Tang, Tianping Deng, Bo Xu, Chen Zhang et al.
5 links
Symmetry
Reinforcement Learning in Robotics
article

Cooperative UAV Swarm Data Collection: Global Coverage Memory and Neuro-Physical Action Control with FSCM-MAPPO

Ziyi Tang, Tianping Deng, Bo Xu, Chen Zhang, Xinru Li, Yunsheng Xu, Yunfei Lu, Xingchen Xiang
article en

Abstract

The increasing deployment of Unmanned Aerial Vehicle (UAV) swarms in Internet of Things (IoT) systems enables large-scale cooperative data collection. However, cooperative data collection by UAV swarms remains difficult due to sparse rewards, redundant exploration, inefficient coordination, and the need to refine discrete policy proposals before environment execution. To address these limitations, this paper studies cooperative UAV target collection in randomized simulated environments with observable target and obstacle locations and proposes a Full Spatial Coverage Memory Multi-Agent Proximal Policy Optimization (FSCM-MAPPO), a cooperative data collection algorithm integrating global perception grid with dynamic shared memory, a dense reward shaping mechanism, and a neuro-physical hybrid action controller. Specifically, a global perception grid with dynamic shared memory provides explicit spatial memory and coverage awareness, in which the global coverage information is complementary to each UAV’s local observation, thereby alleviating reward sparsity and redundant search. A neuro-physical hybrid action controller refines policy outputs through local geometric screening, velocity-based intent refinement, and discrete action selection. In an enhanced Multi-Agent Particle Environment with dynamic energy constraints, FSCM-MAPPO attains 71.80±9.73% full-task success and 95.77±1.67% target collection across five independent seeds under deterministic action selection, outperforming the tested MARL baselines. Ablations further show that coverage memory improves visitation and reduces repeated visits, while dense shaping and hybrid control aid task completion. Furthermore, fixed-policy comparisons reveal that hybrid control reduces accumulated contact exposure but increases contact-entry events, indicating a trade-off between task completion and contact behavior.

SymmetryVol. 18(11)
Huazhong University of Science and Technology (CN)
Openalex Percentile: Top 14%
Reinforcement Learning in Robotics
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon