Optimization of D2D emergency communication resources for UAV relay based on DA-STD3

The allocation of communication resources is extremely important for the device-to-device (D2D) communication network with unmanned aerial vehicle (UAV) relays, but this field currently mainly focuses on the communication between UAVs and ground devices. While neglecting the comprehensive optimization of air-to-ground communication and internal ground communication. This paper studies the optimization problem of communication for ground D2D devices based on UAV relays in urban environment. We study the comprehensive optimization considering the air-to-ground communication and the mobile ground communication devices. We construct the D2D communication neighbor table, and the terrestrial D2D devices will sort and select the best D2D link for pairing based on the Euclidean distance and gain set around them. We construct a communication model for this scenario and propose an improved Dual-Actor Network Softmax Twin Delayed Deep Deterministic Policy Gradient algorithm based on deep reinforcement learning. We perform transmit power optimization to address the interference caused by D2D communication using frequency division multiplexing technology. By designing the reward function and training mechanism, we can achieve good power control and reduce communication interference. The results of the simulation analysis performed in this scenario show an effective reduction in communication latency and an increase in D2I (device-to-infrastructure) channel capacity, D2D connectivity success, and energy efficiency. The feasibility and effectiveness of the algorithm is verified by comparing the baseline algorithm.