Hierarchical Reinforcement Learning for Viewpoint Planning with Scalable Precision in UAV Inspection
Viewpoint planning is crucial to ensure both inspection efficiency and observation precision in UAV inspection tasks. To address the issues of excessive waypoints and inadequate observation precision in traditional methods, this paper proposes a hierarchical reinforcement learning-based viewpoint planning method. The proposed method decomposes the viewpoint planning task into a high-level waypoint planning strategy and a low-level pose and zoom planning strategy. Additionally, a reward function is designed to enhance inspection precision, enabling collaborative optimization of waypoint positions, viewpoint poses, and focal lengths. Experimental results show that, compared with the classic coverage path planning method and non-hierarchical reinforcement learning approaches, the proposed method reduces the number of waypoints by at least 70% across multiple inspection objects. Furthermore, experiments with viewpoint planning at different precision levels demonstrate that the proposed method achieves scalable precision during inspection, with the observation resolution improving to 1.51 pixels/mm. Finally, a qualitative comparison is made between the proposed method in this paper and other representative methods in viewpoint planning. These results effectively demonstrate the validity and superiority of the proposed method in improving both inspection task efficiency and observation precision.
Authors
- Mengyang Pu (ORCID: https://orcid.org/0000-0002-4159-9043)
- Yihuan Li (ORCID: https://orcid.org/0000-0002-5521-9224)
- Yanxiong Wu
- Li Sun (ORCID: https://orcid.org/0000-0003-4562-2279)
- Hao Li (ORCID: https://orcid.org/0000-0002-4019-3420)
- Hua Wu (ORCID: https://orcid.org/0000-0002-5687-7800)
- Juncheng Liu (ORCID: https://orcid.org/0000-0002-5895-0581)
- Xiaojing Bai (ORCID: https://orcid.org/0000-0002-9883-397X)
- Junwei Yu
Institutions
- North China Electric Power University (CN)
- Institute of Disaster Prevention (CN)
Publication Details
- Journal
- Drones
- Published
- 2025-05-05
- DOI
- https://doi.org/10.3390/drones9050352
- Primary Topic
- Robotics and Sensor-Based Localization
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Natural Science Foundation of China
- Fundamental Research Funds for the Central Universities