Robust Control of OpenMANIPULATOR-X Using Reinforcement Learning

This study introduces an innovative method for enhancing the control of the OpenMANIPULATOR-X robot, integrating Fixed-Time Sliding Mode (FTSM) control with the Deep Deterministic Policy Gradient (DDPG) algorithm. The main objective of this research is to minimize positional inaccuracies and mitigate chattering that can occur during the robot’s operation. By utilizing the DDPG algorithm, a reinforcement learning (RL) agent is trained to optimize the control gains for the FTSM technique. The simulation results presented in the study highlight the effectiveness of this approach in reducing both position errors and chattering. Incorporating advanced state and reward selection in the RL framework is essential for optimizing the robot’s performance. Overall, this methodology shows promise for improving the precision and reliability of the OpenMANIPULATOR-X, particularly in uncertain environments.

Authors

Institutions

Publication Details

Journal
IFAC-PapersOnLine
Published
2025-01-01
DOI
https://doi.org/10.1016/j.ifacol.2025.09.120
Primary Topic
Adaptive Control of Nonlinear Systems
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Robust Control of OpenMANIPULATOR-X Using Reinforcement Learning

Allahyar Montazeri, D.K. Mansfield, Mahsa Kashani, Maryam Malekzadeh
IFAC-PapersOnLine
Adaptive Control of Nonlinear Systems
article

Robust Control of OpenMANIPULATOR-X Using Reinforcement Learning

Allahyar Montazeri, D.K. Mansfield, Mahsa Kashani, Maryam Malekzadeh
article en

Abstract

This study introduces an innovative method for enhancing the control of the OpenMANIPULATOR-X robot, integrating Fixed-Time Sliding Mode (FTSM) control with the Deep Deterministic Policy Gradient (DDPG) algorithm. The main objective of this research is to minimize positional inaccuracies and mitigate chattering that can occur during the robot’s operation. By utilizing the DDPG algorithm, a reinforcement learning (RL) agent is trained to optimize the control gains for the FTSM technique. The simulation results presented in the study highlight the effectiveness of this approach in reducing both position errors and chattering. Incorporating advanced state and reward selection in the RL framework is essential for optimizing the robot’s performance. Overall, this methodology shows promise for improving the precision and reliability of the OpenMANIPULATOR-X, particularly in uncertain environments.

IFAC-PapersOnLineVol. 59(10)
Sharif University of Technology (IR), Isfahan University of Technology (IR), University of Isfahan (IR), Lancaster University (GB)
Openalex Percentile: Top 67%
Adaptive Control of Nonlinear Systems
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.