Multi-Agent Deep Reinforcement Learning Based on Soft Actor-Critic for Self-Collaborating UAVs in a Swarm

This paper presents a novel implementation of a decentralized Multi-Agent Deep Reinforcement Learning (MADRL) framework based on Soft Actor-Critic (SAC) for self-collaborating UAV swarms. The proposed approach enables each UAV to maintain formation, avoid obstacles, and collaborate effectively without the need for explicit communication. By leveraging local observations and learned policies, each UAV independently adapts to dynamic and unpredictable conditions in real-time, making the system robust to environmental variability and scalable to large swarms. The paper defines key SAC equations and parameters tailored for the proposed method, demonstrating its potential in scenarios such as disaster management, and search and rescue missions. A comparative analysis with other MADRL methods highlights the advantages of SAC, explaining the rationale behind its selection.

Authors

Institutions

Publication Details

Published
2024-10-16
DOI
https://doi.org/10.1109/ictc62082.2024.10826729
Citations
3
Primary Topic
Distributed Control Multi-Agent Systems
Type
article
Field-Weighted Citation Impact
1.05
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Multi-Agent Deep Reinforcement Learning Based on Soft Actor-Critic for Self-Collaborating UAVs in a Swarm

Alexander M. Pascual, Soo Young Shin
3 citations
Distributed Control Multi-Agent Systems
1.05
article

Multi-Agent Deep Reinforcement Learning Based on Soft Actor-Critic for Self-Collaborating UAVs in a Swarm

Alexander M. Pascual, Soo Young Shin
article en
3 citations

Abstract

This paper presents a novel implementation of a decentralized Multi-Agent Deep Reinforcement Learning (MADRL) framework based on Soft Actor-Critic (SAC) for self-collaborating UAV swarms. The proposed approach enables each UAV to maintain formation, avoid obstacles, and collaborate effectively without the need for explicit communication. By leveraging local observations and learned policies, each UAV independently adapts to dynamic and unpredictable conditions in real-time, making the system robust to environmental variability and scalable to large swarms. The paper defines key SAC equations and parameters tailored for the proposed method, demonstrating its potential in scenarios such as disaster management, and search and rescue missions. A comparative analysis with other MADRL methods highlights the advantages of SAC, explaining the rationale behind its selection.

Kumoh National Institute of Technology (KR)
Openalex Percentile: Top 20%
Distributed Control Multi-Agent Systems
1.05
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.