Enhancing Sim-to-Real Transfer for a High-Gear-Ratio Quadruped Robot via Extended Actuator Dynamics Identification
Reinforcement learning (RL) has become a powerful tool for quadrupedal locomotion, and a sim-to-real approach is widely adopted to avoid hardware damage during training. However, the “sim-to-real gap” remains a critical challenge, particularly for robots driven by high-gear-ratio actuators, in which nonlinear friction effects are strongly amplified. Conventional methods, such as actuator networks or heuristic domain randomization, often require specialized sensors or extensive trial-and-error to tune appropriate randomization ranges. Building on a recent system-identification framework for actuator dynamics, we extend it with an augmented friction model that incorporates the Stribeck effect to capture the low-velocity nonlinearities characteristic of high-gear-ratio actuators. The physical parameters are identified from real-robot trajectory data using an evolutionary algorithm, and the resulting simulation is used to train a locomotion policy that is transferred zero-shot to a 55 kg quadruped without additional fine-tuning or base- or controller-level dynamics randomization. On our platform, adding the Stribeck term lowers the actuator identification error by 16% relative to a Coulomb–Viscous model on the trajectory used for identification, and this advantage generalizes to an unseen trajectory not used for identification. It also lowers the simulation-to-reality mean-velocity degradation from 40.2% and 26.8% for the Coulomb–Viscous model to 27.2% and 21.6% for our method at the 0.3 and 1.0 m/s commands, respectively. The trained policy achieves stable locomotion on flat ground as well as rough terrain including steps and stairs. These results indicate that explicitly modeling low-velocity friction is beneficial for high-fidelity sim-to-real transfer in high-reduction systems.
Authors
- Hyouk Ryeol Choi (ORCID: https://orcid.org/0000-0003-2902-7453)
- 남성원
- Hyeonwoo Yu (ORCID: https://orcid.org/0000-0002-9505-7581)
- Yeongwoo Son (ORCID: https://orcid.org/0000-0002-3518-1206)
- Hansol Kang (ORCID: https://orcid.org/0000-0002-8672-2359)
- Hyunyong Lee
- Bumsu Yi
- Jaeyoung Oh
- Jiman Park (ORCID: https://orcid.org/0009-0006-9410-192X)
Institutions
- Korea Institute of Robot and Convergence (KR)
- Sungkyunkwan University (KR)
Publication Details
- Journal
- Machines
- Published
- 2026-09-09
- DOI
- https://doi.org/10.3390/machines14091031
- Primary Topic
- Robotic Locomotion and Control
- Type
- article
- Field-Weighted Citation Impact
- 0.00