Deep Reinforcement Learning Algorithm with Long Short-Term Memory Network for Optimizing Unmanned Aerial Vehicle Information Transmission
The optimization of information transmission in unmanned aerial vehicles (UAVs) is essential for enhancing their operational efficiency across various applications. This issue is framed as a mixed-integer nonconvex optimization challenge, which traditional optimization algorithms and reinforcement learning (RL) methods often struggle to address effectively. In this paper, we propose a novel deep reinforcement learning algorithm that utilizes a hybrid discrete–continuous action space. To address the long-term dependency issues inherent in UAV operations, we incorporate a long short-term memory (LSTM) network. Our approach accounts for the specific flight constraints of fixed-wing UAVs and employs a continuous policy network to facilitate real-time flight path planning. A non-sparse reward function is designed to maximize data collection from internet of things (IoT) devices, thus guiding the UAV to optimize its operational efficiency. Experimental results demonstrate that the proposed algorithm yields near-optimal flight paths and significantly improves data collection capabilities, compared to conventional heuristic methods, achieving an improvement of up to 10.76%. Validation through simulations confirms the effectiveness and practicality of the proposed approach in real-world scenarios.
Authors
- Yufei He
- Ruiqi Hu (ORCID: https://orcid.org/0009-0003-9989-5042)
- Kewei Liang (ORCID: https://orcid.org/0000-0002-3837-6439)
- Youngjoon Hong (ORCID: https://orcid.org/0000-0003-4956-8660)
- Zhiyuan Zhou (ORCID: https://orcid.org/0000-0003-0258-484X)
Institutions
- Beijing Normal-Hong Kong Baptist University (CN)
- Hong Kong Baptist University (HK)
- Hong Kong Polytechnic University (HK)
- Beijing Normal University (CN)
- Hangzhou Wanxiang Polytechnic (CN)
- Zhejiang University (CN)
Publication Details
- Journal
- Mathematics
- Published
- 2024-12-26
- DOI
- https://doi.org/10.3390/math13010046
- Citations
- 5
- Primary Topic
- UAV Applications and Optimization
- Type
- article
- Field-Weighted Citation Impact
- 6.49
Funders
- National Natural Science Foundation of China