Adaptive Multi-UAV Formation Navigation in Narrow Passages via Reinforcement Learning with Task-Decomposed Hierarchical Training

Multi-UAV formation navigation in narrow passages requires coordinated collision avoidance and adaptive formation adjustment under geometric constraints. This paper proposes a leader–follower framework based on task-decomposed hierarchical Soft Actor–Critic (SAC) training. The leader is first trained to establish a stable navigation reference, after which its policy is fixed for follower training. A heterogeneous GRU–CNN (G-C) perception network processes proprioceptive and LiDAR observations, while distance-dependent formation-reward weighting enables progressive formation compression and recovery without predefined switching rules. Experiments on four narrow-passage topologies included in training show that the proposed method achieves 100% task success with mean formation-tracking errors of 0.2734–0.4263 m in static environments, and 90–100% task success with errors of 0.3838–0.5374 m in dynamic environments. Comparisons with hierarchical Proximal Policy Optimization (PPO) and curriculum-assisted multi-agent reinforcement learning baselines demonstrate a more favorable balance between task success and formation-tracking accuracy, particularly under moving-obstacle interference. These results demonstrate the effectiveness of the proposed framework within the evaluated scenarios.

Authors

Institutions

Publication Details

Journal
Sensors
Published
2026-11-18
DOI
https://doi.org/10.3390/s26227294
Primary Topic
Reinforcement Learning in Robotics
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Adaptive Multi-UAV Formation Navigation in Narrow Passages via Reinforcement Learning with Task-Decomposed Hierarchical Training

Liangdong Wen, Huiliao Yang, Dawei Wu, Jian Li
6 links
Sensors
Reinforcement Learning in Robotics
article

Adaptive Multi-UAV Formation Navigation in Narrow Passages via Reinforcement Learning with Task-Decomposed Hierarchical Training

Liangdong Wen, Huiliao Yang, Dawei Wu, Jian Li
article en

Abstract

Multi-UAV formation navigation in narrow passages requires coordinated collision avoidance and adaptive formation adjustment under geometric constraints. This paper proposes a leader–follower framework based on task-decomposed hierarchical Soft Actor–Critic (SAC) training. The leader is first trained to establish a stable navigation reference, after which its policy is fixed for follower training. A heterogeneous GRU–CNN (G-C) perception network processes proprioceptive and LiDAR observations, while distance-dependent formation-reward weighting enables progressive formation compression and recovery without predefined switching rules. Experiments on four narrow-passage topologies included in training show that the proposed method achieves 100% task success with mean formation-tracking errors of 0.2734–0.4263 m in static environments, and 90–100% task success with errors of 0.3838–0.5374 m in dynamic environments. Comparisons with hierarchical Proximal Policy Optimization (PPO) and curriculum-assisted multi-agent reinforcement learning baselines demonstrate a more favorable balance between task success and formation-tracking accuracy, particularly under moving-obstacle interference. These results demonstrate the effectiveness of the proposed framework within the evaluated scenarios.

SensorsVol. 26(22)
Hohai University (CN)
National Natural Science Foundation of China
Reinforcement Learning in Robotics
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon