Adaptive Motion Trajectory Control Method for Robots Based on Reinforcement Learning

Accurate manipulator trajectory control becomes difficult when nonlinear joint coupling, payload variation, and external disturbances invalidate fixed controller parameters. This study develops an adaptive trajectory controller based on Proximal Policy Optimization for a seven-degree-of-freedom Franka Emika Panda manipulator. The controller maps joint states, Cartesian tracking errors, target motion, and previous actions directly to continuous joint torques. Training is conducted in MuJoCo with randomized 0–2 kg payloads and 5–20 N external forces, while a composite reward simultaneously regulates Cartesian accuracy, orientation error, motion smoothness, control effort, and safety. Illustrative evaluation results show that PPO achieves a Cartesian RMSE of 6.84 ± 0.73 mm on the three-dimensional trajectory, compared with 13.27 ± 1.46 mm for computed-torque control and 21.63 ± 2.11 mm for PID. Under a 20 N disturbance, recovery time decreases to 0.41 ± 0.06 s, while trajectory jerk remains 31.7 ± 3.8 m/s³. The results indicate that dynamic randomization and multi-objective reward shaping enable the learned controller to preserve tracking accuracy and smoothness under changing robot dynamics.

Authors

Institutions

Publication Details

Journal
Applied and Computational Engineering
Published
2026-11-17
DOI
https://doi.org/10.54254/2755-2721/2026.ld39039
Primary Topic
Reinforcement Learning in Robotics
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Adaptive Motion Trajectory Control Method for Robots Based on Reinforcement Learning

Miao Zhang
1 links
Applied and Computational Engineering
Reinforcement Learning in Robotics
article

Adaptive Motion Trajectory Control Method for Robots Based on Reinforcement Learning

Miao Zhang
article en

Abstract

Accurate manipulator trajectory control becomes difficult when nonlinear joint coupling, payload variation, and external disturbances invalidate fixed controller parameters. This study develops an adaptive trajectory controller based on Proximal Policy Optimization for a seven-degree-of-freedom Franka Emika Panda manipulator. The controller maps joint states, Cartesian tracking errors, target motion, and previous actions directly to continuous joint torques. Training is conducted in MuJoCo with randomized 0–2 kg payloads and 5–20 N external forces, while a composite reward simultaneously regulates Cartesian accuracy, orientation error, motion smoothness, control effort, and safety. Illustrative evaluation results show that PPO achieves a Cartesian RMSE of 6.84 ± 0.73 mm on the three-dimensional trajectory, compared with 13.27 ± 1.46 mm for computed-torque control and 21.63 ± 2.11 mm for PID. Under a 20 N disturbance, recovery time decreases to 0.41 ± 0.06 s, while trajectory jerk remains 31.7 ± 3.8 m/s³. The results indicate that dynamic randomization and multi-objective reward shaping enable the learned controller to preserve tracking accuracy and smoothness under changing robot dynamics.

Applied and Computational EngineeringVol. 285(1)
Beijing Jiaotong University (CN)
Reinforcement Learning in Robotics
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon