UAV Position Optimization for Servicing Ground Users Based on Deep Reinforcement Learning

Abstract A Deep Q-Network (DQN) algorithm is proposed for optimization of UAVs, which can increase the communication rate of multiple users within a certain area. The UAV is able to automatically adjust its position in 3D by means of the DQN Agent’s design and training, and then get the best UAV placement location. Furthermore, the Double Deep Q-Network (Double DQN) has been researched. It has been proved that this method has higher efficiency and higher convergence rate compared with traditional DQN for locating optimal UAV position. In this paper, we perform a complex simulation of a random distribution of users in a simulated region. The experimental results indicate that UAV is able to locate the optimal position with maximum mean transfer rate, and reduce the distance from central point to customer centre, thus increasing the communication quality. This study not only verifies the effectiveness of deep reinforcement learning in dynamic positioning optimization, but also provides new insights for the optimization design of future intelligent communication systems.

Authors

Institutions

Publication Details

Journal
Journal of Physics Conference Series
Published
2024-10-01
DOI
https://doi.org/10.1088/1742-6596/2861/1/012011
Citations
1
Primary Topic
UAV Applications and Optimization
Type
article
Field-Weighted Citation Impact
1.30
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

UAV Position Optimization for Servicing Ground Users Based on Deep Reinforcement Learning

Shumei Liu, Feiyu Gao, Xuan Liu, Zichen Wang
1 citations
Journal of Physics Conference Series
UAV Applications and Optimization
1.30
article

UAV Position Optimization for Servicing Ground Users Based on Deep Reinforcement Learning

Shumei Liu, Feiyu Gao, Xuan Liu, Zichen Wang
article en
1 citations

Abstract

Abstract A Deep Q-Network (DQN) algorithm is proposed for optimization of UAVs, which can increase the communication rate of multiple users within a certain area. The UAV is able to automatically adjust its position in 3D by means of the DQN Agent’s design and training, and then get the best UAV placement location. Furthermore, the Double Deep Q-Network (Double DQN) has been researched. It has been proved that this method has higher efficiency and higher convergence rate compared with traditional DQN for locating optimal UAV position. In this paper, we perform a complex simulation of a random distribution of users in a simulated region. The experimental results indicate that UAV is able to locate the optimal position with maximum mean transfer rate, and reduce the distance from central point to customer centre, thus increasing the communication quality. This study not only verifies the effectiveness of deep reinforcement learning in dynamic positioning optimization, but also provides new insights for the optimization design of future intelligent communication systems.

Journal of Physics Conference SeriesVol. 2861(1)
Chang'an University (CN)
Openalex Percentile: Top 12%
UAV Applications and Optimization
1.30
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.