Adaptive Multi-UAV Formation Navigation in Narrow Passages via Reinforcement Learning with Task-Decomposed Hierarchical Training
Multi-UAV formation navigation in narrow passages requires coordinated collision avoidance and adaptive formation adjustment under geometric constraints. This paper proposes a leader–follower framework based on task-decomposed hierarchical Soft Actor–Critic (SAC) training. The leader is first trained to establish a stable navigation reference, after which its policy is fixed for follower training. A heterogeneous GRU–CNN (G-C) perception network processes proprioceptive and LiDAR observations, while distance-dependent formation-reward weighting enables progressive formation compression and recovery without predefined switching rules. Experiments on four narrow-passage topologies included in training show that the proposed method achieves 100% task success with mean formation-tracking errors of 0.2734–0.4263 m in static environments, and 90–100% task success with errors of 0.3838–0.5374 m in dynamic environments. Comparisons with hierarchical Proximal Policy Optimization (PPO) and curriculum-assisted multi-agent reinforcement learning baselines demonstrate a more favorable balance between task success and formation-tracking accuracy, particularly under moving-obstacle interference. These results demonstrate the effectiveness of the proposed framework within the evaluated scenarios.
Authors
- Liangdong Wen (ORCID: https://orcid.org/0000-0003-4688-9477)
- Huiliao Yang (ORCID: https://orcid.org/0000-0002-9314-9183)
- Dawei Wu (ORCID: https://orcid.org/0000-0002-4105-3614)
- Jian Li (ORCID: https://orcid.org/0009-0006-1992-8716)
Institutions
- Hohai University (CN)
Publication Details
- Journal
- Sensors
- Published
- 2026-11-18
- DOI
- https://doi.org/10.3390/s26227294
- Primary Topic
- Reinforcement Learning in Robotics
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Natural Science Foundation of China