An Intelligent Relay Nodes Deployment Method Based on Multi-Agent Deep Reinforcement Learning For Emergency Communications

In emergency communication scenarios, task nodes often need to perform rescue missions in areas lacking basic network coverage. To ensure reliable communication, emergency communication relay networks are constructed, necessitating relay nodes to establish multiple relay links and dynamically adjust the network topology and the number of nodes. Traditional relay deployment schemes, which rely on heuristic algorithms, often lack flexibility and may become trapped in local optima. To address these issues, we propose an Intelligent Relay Nodes Deployment Method (INDM). This method combines Twin Delayed Deep Deterministic Policy Gradient (TD3) and Double Deep Q-Network (DQN) algorithms to optimize the number and placement of nodes in the relay link. Additionally, an adaptive segmented reward function is designed to guide agent iterations, while noise exploration mechanisms and an adaptive experience replay algorithm enable agents to fully explore and identify optimal strategies. Simulation results demonstrate that our algorithm effectively reduces relay node energy consumption and the total number of nodes, all while ensuring high communication quality for task nodes.

Authors

Institutions

Publication Details

Published
2024-10-07
DOI
https://doi.org/10.1109/vtc2024-fall63153.2024.10757646
Primary Topic
Indoor and Outdoor Localization Technologies
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

An Intelligent Relay Nodes Deployment Method Based on Multi-Agent Deep Reinforcement Learning For Emergency Communications

Yuanan Liu, Kaiming Liu, Shuxiang Yang, Jiang Wu
Indoor and Outdoor Localization Technologies
article

An Intelligent Relay Nodes Deployment Method Based on Multi-Agent Deep Reinforcement Learning For Emergency Communications

Yuanan Liu, Kaiming Liu, Shuxiang Yang, Jiang Wu
article en

Abstract

In emergency communication scenarios, task nodes often need to perform rescue missions in areas lacking basic network coverage. To ensure reliable communication, emergency communication relay networks are constructed, necessitating relay nodes to establish multiple relay links and dynamically adjust the network topology and the number of nodes. Traditional relay deployment schemes, which rely on heuristic algorithms, often lack flexibility and may become trapped in local optima. To address these issues, we propose an Intelligent Relay Nodes Deployment Method (INDM). This method combines Twin Delayed Deep Deterministic Policy Gradient (TD3) and Double Deep Q-Network (DQN) algorithms to optimize the number and placement of nodes in the relay link. Additionally, an adaptive segmented reward function is designed to guide agent iterations, while noise exploration mechanisms and an adaptive experience replay algorithm enable agents to fully explore and identify optimal strategies. Simulation results demonstrate that our algorithm effectively reduces relay node energy consumption and the total number of nodes, all while ensuring high communication quality for task nodes.

Beijing University of Posts and Telecommunications (CN)
Openalex Percentile: Top 76%
Indoor and Outdoor Localization Technologies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.