UAV Mission Planning for Post-Disaster Victim Localisation via Federated Multi-Agent Reinforcement Learning

Rapid localisation of trapped victims after urban disasters is essential but challenging because Bluetooth Low Energy (BLE) beacons are intermittent, radio propagation is obstructed by rubble, UAVs are energy-constrained, and real-world multi-UAV training is impractical in high-risk search-and-rescue (SAR) environments. This study formulates post-disaster victim localisation as a cooperative Dec-POMDP and adapts a model-aided federated multi-agent reinforcement learning framework based on FedQMIX. The proposed pipeline combines a lightweight LoS/NLoS surrogate channel model, PSO-based victim-position estimation, return-to-base and map-feasibility safety checks, an SAR-aligned shaped reward, and a leakage-free centralised training state based on estimated rather than ground-truth victim locations. Each UAV trains locally inside a learned digital-twin simulator and periodically shares only QMIX network parameters, avoiding the exchange of raw trajectories or RSSI logs. The framework is evaluated on two synthetic post-earthquake urban maps representing a compact return-to-base scenario and a larger reach-to-destination scenario. Across five independent seeds per method and map, Model-Aided FedQMIX achieves the highest and most stable victim-localisation performance, with the clearest advantage observed in the larger long-horizon scenario. Additional diagnostic tests examine reward-weight sensitivity, RF channel-shift robustness, BLE/smartphone hardware heterogeneity, non-IID client-data variation, and partial-client FedAvg under missing client updates. The results indicate that combining model-aided localisation cues, decentralised value factorisation, SAR-aligned objective design, and federated parameter sharing can improve the robustness of UAV-based victim-localisation policies. The framework also clarifies deployment considerations for federated SAR coordination, including communication payload, privacy boundaries, heterogeneous client experience, device variability, and intermittent connectivity. This study remains simulation-based, and future validation with real UAVs, BLE devices, and rubble-inspired testbeds is required before operational deployment.

Authors

Institutions

Publication Details

Journal
Drones
Published
2026-05-18
DOI
https://doi.org/10.3390/drones10050385
Primary Topic
UAV Applications and Optimization
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

UAV Mission Planning for Post-Disaster Victim Localisation via Federated Multi-Agent Reinforcement Learning

Fazlı Yildirim, Mehmet Akif Çifçi, Alparslan Güzey, Arda Yaşar Erdoğan
Drones
UAV Applications and Optimization
article

UAV Mission Planning for Post-Disaster Victim Localisation via Federated Multi-Agent Reinforcement Learning

Fazlı Yildirim, Mehmet Akif Çifçi, Alparslan Güzey, Arda Yaşar Erdoğan
article en

Abstract

Rapid localisation of trapped victims after urban disasters is essential but challenging because Bluetooth Low Energy (BLE) beacons are intermittent, radio propagation is obstructed by rubble, UAVs are energy-constrained, and real-world multi-UAV training is impractical in high-risk search-and-rescue (SAR) environments. This study formulates post-disaster victim localisation as a cooperative Dec-POMDP and adapts a model-aided federated multi-agent reinforcement learning framework based on FedQMIX. The proposed pipeline combines a lightweight LoS/NLoS surrogate channel model, PSO-based victim-position estimation, return-to-base and map-feasibility safety checks, an SAR-aligned shaped reward, and a leakage-free centralised training state based on estimated rather than ground-truth victim locations. Each UAV trains locally inside a learned digital-twin simulator and periodically shares only QMIX network parameters, avoiding the exchange of raw trajectories or RSSI logs. The framework is evaluated on two synthetic post-earthquake urban maps representing a compact return-to-base scenario and a larger reach-to-destination scenario. Across five independent seeds per method and map, Model-Aided FedQMIX achieves the highest and most stable victim-localisation performance, with the clearest advantage observed in the larger long-horizon scenario. Additional diagnostic tests examine reward-weight sensitivity, RF channel-shift robustness, BLE/smartphone hardware heterogeneity, non-IID client-data variation, and partial-client FedAvg under missing client updates. The results indicate that combining model-aided localisation cues, decentralised value factorisation, SAR-aligned objective design, and federated parameter sharing can improve the robustness of UAV-based victim-localisation policies. The framework also clarifies deployment considerations for federated SAR coordination, including communication payload, privacy boundaries, heterogeneous client experience, device variability, and intermittent connectivity. This study remains simulation-based, and future validation with real UAVs, BLE devices, and rubble-inspired testbeds is required before operational deployment.

DronesVol. 10(5)
Duy Tan University (VN), Robotics Research (United States) (US), Istanbul University (TR)
Sustainable cities and communities
Openalex Percentile: Top 2%
UAV Applications and Optimization
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.