Reinforcement learning-driven deep learning approaches for optimized robot trajectory planning

Trajectory planning and control of bipedal walking robots require precise joint torque computation to ensure stability and efficiency. Given the nonlinear dynamics and complex interactions of bipedal systems, achieving stable walking remains a major challenge. Deep reinforcement learning (DRL) offers a promising solution by directly mapping observed states to optimal actions that maximize cumulative rewards. In this work, we integrate deep learning-based trajectory planning with a DRL-driven control system to generate optimal joint torque sequences. Our approach aims to achieve stable walking with maximum forward speed, minimal power consumption, and enhanced stability to prevent falls. After training, the bipedal robot demonstrates stable and resilient locomotion, maintaining balance throughout the gait cycle. Additionally, it exhibits robust performance under uncertainties, handling mass variations of up to 20% and length variations of up to 5%. The robot effectively rejects disturbances at different angular velocities across various gait phases, enhancing adaptability. This approach improves the robustness and efficiency of bipedal robots, making them more suitable for real-world applications requiring reliable and adaptive locomotion.

Authors

Institutions

Publication Details

Journal
Scientific Reports
Published
2025-10-29
DOI
https://doi.org/10.1038/s41598-025-21664-5
Citations
2
Primary Topic
Robotic Locomotion and Control
Type
article
Field-Weighted Citation Impact
1.35
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Reinforcement learning-driven deep learning approaches for optimized robot trajectory planning

Fang Shiyu
2 citations
Scientific Reports
Robotic Locomotion and Control
1.35
article

Reinforcement learning-driven deep learning approaches for optimized robot trajectory planning

Fang Shiyu
article en
2 citations

Abstract

Trajectory planning and control of bipedal walking robots require precise joint torque computation to ensure stability and efficiency. Given the nonlinear dynamics and complex interactions of bipedal systems, achieving stable walking remains a major challenge. Deep reinforcement learning (DRL) offers a promising solution by directly mapping observed states to optimal actions that maximize cumulative rewards. In this work, we integrate deep learning-based trajectory planning with a DRL-driven control system to generate optimal joint torque sequences. Our approach aims to achieve stable walking with maximum forward speed, minimal power consumption, and enhanced stability to prevent falls. After training, the bipedal robot demonstrates stable and resilient locomotion, maintaining balance throughout the gait cycle. Additionally, it exhibits robust performance under uncertainties, handling mass variations of up to 20% and length variations of up to 5%. The robot effectively rejects disturbances at different angular velocities across various gait phases, enhancing adaptability. This approach improves the robustness and efficiency of bipedal robots, making them more suitable for real-world applications requiring reliable and adaptive locomotion.

Scientific ReportsVol. 15(1)
Shandong University of Science and Technology (CN)
Openalex Percentile: Top 17%
Robotic Locomotion and Control
1.35
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.