Self-Learning Robot Manipulator Controller Using Reinforcement Learning

Traditionally, robot control has relied on mathematical solutions, particularly inverse kinematics (IK), to determine the joint angles needed for a desired end-effector pose. However, these solutions face significant challenges as robots increase in complexity with higher degrees-of-freedom (DoF) and adaptability requirements. This work introduces an approach for controlling robot manipulators by addressing the IK problem using the artificial intelligence (AI) technique. In this paper, a deep reinforcement learning approach is proposed to solve the IK problem for a 6-DoF industrial robot manipulator. The Deep Deterministic Policy Gradient (DDPG) algorithm is employed to train an agent capable of learning the robot's motion, allowing for random initial and target positions and orientations. Several reward functions are implemented to enhance the accuracy of the robot's movement towards the desired position and orientation. This proposed approach demonstrates a high success rate and low mean error, outperforming other state-of-the-art methods. Furthermore, the approach is validated on a physical robot, confirming its practical applicability and effectiveness.

Authors

Institutions

Publication Details

Published
2024-12-01
DOI
https://doi.org/10.1109/tencon61640.2024.10903051
Citations
1
Primary Topic
Reinforcement Learning in Robotics
Type
article
Field-Weighted Citation Impact
0.35
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Self-Learning Robot Manipulator Controller Using Reinforcement Learning

Hudyjaya Siswoyo Jo, Ong Yu Xhin
1 citations
Reinforcement Learning in Robotics
0.35
article

Self-Learning Robot Manipulator Controller Using Reinforcement Learning

Hudyjaya Siswoyo Jo, Ong Yu Xhin
article en
1 citations

Abstract

Traditionally, robot control has relied on mathematical solutions, particularly inverse kinematics (IK), to determine the joint angles needed for a desired end-effector pose. However, these solutions face significant challenges as robots increase in complexity with higher degrees-of-freedom (DoF) and adaptability requirements. This work introduces an approach for controlling robot manipulators by addressing the IK problem using the artificial intelligence (AI) technique. In this paper, a deep reinforcement learning approach is proposed to solve the IK problem for a 6-DoF industrial robot manipulator. The Deep Deterministic Policy Gradient (DDPG) algorithm is employed to train an agent capable of learning the robot's motion, allowing for random initial and target positions and orientations. Several reward functions are implemented to enhance the accuracy of the robot's movement towards the desired position and orientation. This proposed approach demonstrates a high success rate and low mean error, outperforming other state-of-the-art methods. Furthermore, the approach is validated on a physical robot, confirming its practical applicability and effectiveness.

Swinburne University of Technology Sarawak Campus (MY)
Reduced inequalities
Openalex Percentile: Top 29%
Reinforcement Learning in Robotics
0.35
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Self-Learning Robot Manipulator Controller Using Reinforcement Learning — Hudyjaya Siswoyo Jo, Ong Yu Xhin · (2024) | TGRS Research Map | TGRS