Bipedal Robot Gait Control Strategies Based on Reinforcement Learning
This paper presents a reinforcement learning-based gait control strategy for bipedal robots. The work focuses on enabling the robot to adapt to complex terrains without relying on visual information. By leveraging the neural network's fitting capability in a simulated environment, the robot estimates privileged information from limited proprioceptive data. The approach is based on reinforcement learning fundamentals and includes a teacher-student policy architecture. We design a series of reward functions to achieve velocity tracking, periodic gait phases, accurate foot traj ectories, and smooth locomotion. Domain randomization is employed to bridge the gap between simulation and reality. Experiments using Proximal Policy Optimization show promising results, and the future work aims to deploy the policy on a real humanoid robot and explore full-body walking strategies.
Authors
- Jiawen Ding
- Nanyan Shen
- Chong Li (ORCID: https://orcid.org/0000-0001-9382-4727)
- Jing Li (ORCID: https://orcid.org/0000-0002-9043-8633)
- Bin Zhou (ORCID: https://orcid.org/0000-0003-0779-3317)
- Zhengquan Mao
Institutions
- Shanghai University (CN)
Publication Details
- Published
- 2024-09-20
- DOI
- https://doi.org/10.1109/isrimt63979.2024.10875312
- Primary Topic
- Gait Recognition and Analysis
- Type
- article
- Field-Weighted Citation Impact
- 0.00