Deep Reinforcement Learning for a Four Degree of Freedom Robot Arm Accelerated by Human Demonstration

This work investigates the use of deep reinforcement learning (DRL) for training a four-degree-of-freedom (4-DOF) robotic arm to efficiently and adaptively reach arbitrary target positions. A dueling double deep Q-network (D3QN) manages the large state-action space, while human demonstration data guides the agent's policy toward more human-like and effective trajectories. Experimental results show that integrating human demonstrations enables the robot arm to achieve more precise target positioning more frequently and in fewer steps than a purely self-trained agent. To assess generality and adaptability, the approach is tested on both a PhantomX Reactor robot arm and a Dobot Magician robot arm, with adjustments made to the Denavit-Hartenberg parameters of the latter. After running 5000 simulated training episodes on each platform, the resulting model is then implemented on the Dobot hardware for 50 episodes, demonstrating the feasibility of accurately controlling a robotic arm model different from the one used during training. The method's potential extends to practical computer vision-guided tasks such as pick-and-place or peg insertion, thus showcasing its versatility in both simulation and physical implementations.

Authors

Institutions

Publication Details

Published
2025-03-07
DOI
https://doi.org/10.1109/icdt63985.2025.10986448
Primary Topic
Robot Manipulation and Learning
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Deep Reinforcement Learning for a Four Degree of Freedom Robot Arm Accelerated by Human Demonstration

R Hernández, Kirk Duran, Sudhir Shrestha
Robot Manipulation and Learning
article

Deep Reinforcement Learning for a Four Degree of Freedom Robot Arm Accelerated by Human Demonstration

R Hernández, Kirk Duran, Sudhir Shrestha
article en

Abstract

This work investigates the use of deep reinforcement learning (DRL) for training a four-degree-of-freedom (4-DOF) robotic arm to efficiently and adaptively reach arbitrary target positions. A dueling double deep Q-network (D3QN) manages the large state-action space, while human demonstration data guides the agent's policy toward more human-like and effective trajectories. Experimental results show that integrating human demonstrations enables the robot arm to achieve more precise target positioning more frequently and in fewer steps than a purely self-trained agent. To assess generality and adaptability, the approach is tested on both a PhantomX Reactor robot arm and a Dobot Magician robot arm, with adjustments made to the Denavit-Hartenberg parameters of the latter. After running 5000 simulated training episodes on each platform, the resulting model is then implemented on the Dobot hardware for 50 episodes, demonstrating the feasibility of accurately controlling a robotic arm model different from the one used during training. The method's potential extends to practical computer vision-guided tasks such as pick-and-place or peg insertion, thus showcasing its versatility in both simulation and physical implementations.

California Polytechnic State University (US), Sonoma State University (US)
Peace, Justice and strong institutions
Openalex Percentile: Top 89%
Robot Manipulation and Learning
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.