Hopping Control of a Monopod Robot: Reinforcement Learning vs Raibert Heuristic
As a classic control problem, monopod hopping was traditionally solved using a state machine-based approach known as the Raibert Heuristic. Recently, reinforcement learning (RL) has emerged as a powerful alternative for robotic control. In this paper, we apply RL to monopod hopping control and compare its performance with the traditional Raibert Heuristic. Simulations demonstrate that RL achieves faster hopping speeds and better robustness than the Raibert method. Both control strategies were implemented on a simulated monopod robot and evaluated based on hopping speed and robustness. The results highlight RL’s superiority in complex environments, while the Raibert approach remains a good solution for simpler scenarios. (The attached video can be found in https://www.bilibili.com/video/BV1eTxgeuEjV)
Authors
- Zhihao Yuan (ORCID: https://orcid.org/0000-0003-1495-7092)
- Linqi Ye (ORCID: https://orcid.org/0000-0003-3190-7660)
- Houde Liu (ORCID: https://orcid.org/0000-0002-7314-3366)
- Bin Liang (ORCID: https://orcid.org/0000-0001-6310-6214)
Institutions
- Shanghai University (CN)
- Tsinghua–Berkeley Shenzhen Institute (CN)
- Tsinghua University (CN)
Publication Details
- Published
- 2025-03-07
- DOI
- https://doi.org/10.1109/icrca64997.2025.11011014
- Primary Topic
- Reinforcement Learning in Robotics
- Type
- article
- Field-Weighted Citation Impact
- 0.00