Bipedal Robot Gait Control Strategies Based on Reinforcement Learning

This paper presents a reinforcement learning-based gait control strategy for bipedal robots. The work focuses on enabling the robot to adapt to complex terrains without relying on visual information. By leveraging the neural network's fitting capability in a simulated environment, the robot estimates privileged information from limited proprioceptive data. The approach is based on reinforcement learning fundamentals and includes a teacher-student policy architecture. We design a series of reward functions to achieve velocity tracking, periodic gait phases, accurate foot traj ectories, and smooth locomotion. Domain randomization is employed to bridge the gap between simulation and reality. Experiments using Proximal Policy Optimization show promising results, and the future work aims to deploy the policy on a real humanoid robot and explore full-body walking strategies.

Authors

Institutions

Publication Details

Published
2024-09-20
DOI
https://doi.org/10.1109/isrimt63979.2024.10875312
Primary Topic
Gait Recognition and Analysis
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Bipedal Robot Gait Control Strategies Based on Reinforcement Learning

Jiawen Ding, Nanyan Shen, Chong Li, Jing Li et al.
Gait Recognition and Analysis
article

Bipedal Robot Gait Control Strategies Based on Reinforcement Learning

Jiawen Ding, Nanyan Shen, Chong Li, Jing Li, Bin Zhou, Zhengquan Mao
article en

Abstract

This paper presents a reinforcement learning-based gait control strategy for bipedal robots. The work focuses on enabling the robot to adapt to complex terrains without relying on visual information. By leveraging the neural network's fitting capability in a simulated environment, the robot estimates privileged information from limited proprioceptive data. The approach is based on reinforcement learning fundamentals and includes a teacher-student policy architecture. We design a series of reward functions to achieve velocity tracking, periodic gait phases, accurate foot traj ectories, and smooth locomotion. Domain randomization is employed to bridge the gap between simulation and reality. Experiments using Proximal Policy Optimization show promising results, and the future work aims to deploy the policy on a real humanoid robot and explore full-body walking strategies.

Shanghai University (CN)
Openalex Percentile: Top 75%
Gait Recognition and Analysis
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Bipedal Robot Gait Control Strategies Based on Reinforcement Learning — Jiawen Ding, Nanyan Shen, et al. · (2024) | TGRS Research Map | TGRS