Enhancement of Deep Deterministic Policy Gradient for Multi-Agent Robotics in Virtual Simulations

In this research, robots act as multi-agents for pathplanning techniques in unpredictable environments. By using the reinforcement learning method, the target point can be reached most efficiently from the starting point. This paper first introduces the Q-learning algorithm and deep Q-networks, which are implemented to improve the Multi-Agent Deep Deterministic Policy Gradient (IMADDPG). A new algorithm, namely IMADDPG, is proposed in this work based on the deep deterministic policy gradient, utilizing the centralized critic and actor decentralized (CCAD) framework. The benefits and drawbacks of guiding the robot with IMADDPG reinforcement learning techniques are discussed under both static and dynamic obstacle conditions. By employing a reinforcement learning technique, the robot can make intelligent decisions, adapt to changes in its surroundings, and learn from its experiences. To determine the potential of this method for practical applications, the effectiveness and performance of the proposed algorithm are analyzed. The ultimate goal of this work is to create a reliable and efficient robot navigation system capable of navigating effectively in unknown environments. The simulation results of the proposed algorithm are compared with MADDPG, DDPG, D3PG, and DQN, using training episodes up to 2000. The findings reveal a success rate of 96% and a failure rate of 1.2%.

Authors

Institutions

Publication Details

Published
2024-10-25
DOI
https://doi.org/10.1109/giest62955.2024.10959935
Primary Topic
Simulation Techniques and Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Enhancement of Deep Deterministic Policy Gradient for Multi-Agent Robotics in Virtual Simulations

Vasudevan Alagumalai, Vengatesan Arumugam
Simulation Techniques and Applications
article

Enhancement of Deep Deterministic Policy Gradient for Multi-Agent Robotics in Virtual Simulations

Vasudevan Alagumalai, Vengatesan Arumugam
article en

Abstract

In this research, robots act as multi-agents for pathplanning techniques in unpredictable environments. By using the reinforcement learning method, the target point can be reached most efficiently from the starting point. This paper first introduces the Q-learning algorithm and deep Q-networks, which are implemented to improve the Multi-Agent Deep Deterministic Policy Gradient (IMADDPG). A new algorithm, namely IMADDPG, is proposed in this work based on the deep deterministic policy gradient, utilizing the centralized critic and actor decentralized (CCAD) framework. The benefits and drawbacks of guiding the robot with IMADDPG reinforcement learning techniques are discussed under both static and dynamic obstacle conditions. By employing a reinforcement learning technique, the robot can make intelligent decisions, adapt to changes in its surroundings, and learn from its experiences. To determine the potential of this method for practical applications, the effectiveness and performance of the proposed algorithm are analyzed. The ultimate goal of this work is to create a reliable and efficient robot navigation system capable of navigating effectively in unknown environments. The simulation results of the proposed algorithm are compared with MADDPG, DDPG, D3PG, and DQN, using training episodes up to 2000. The findings reveal a success rate of 96% and a failure rate of 1.2%.

Saveetha University (IN)
Openalex Percentile: Top 65%
Simulation Techniques and Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Enhancement of Deep Deterministic Policy Gradient for Multi-Agent Robotics in Virtual Simulations — Vasudevan Alagumalai, Vengatesan Arumugam · (2024) | TGRS Research Map | TGRS