Finite-Horizon Performance Estimation for Online Parameter Refinement in RL–MPC Quadrupedal Locomotion

Reinforcement learning integrated with model predictive control (RL-MPC) enables adaptive quadrupedal locomotion, but learned controller parameters do not explicitly account for their subsequent closed-loop performance. This study proposes a finite-horizon performance estimator (FHPE) to guide online parameter refinement. Trained on rollout data, FHPE predicts the finite-horizon performance of local parameter candidates to guide constrained refinement of the nominal RL proposal. The refined parameters are implemented through MPC and Adaptive Impedance Modulation (AIM), while Transient Residual Compensation (TRC) regulates joint-level responses through spectral regularization and risk-dependent gating. Ablation studies show that FHPE-guided refinement reduces the combined performance cost by 12.68% compared with equal-budget search, while AIM and TRC improve execution performance and transient regulation. Robot performance evaluations demonstrate improved high-speed locomotion capability, an approximately 26% reduction in peak joint acceleration on uneven terrain, and an approximately 43% reduction in estimated mechanical work over 10 m on flat ground in hardware experiments. These findings suggest that finite-horizon performance prediction can improve online parameter selection, while joint-level adaptation helps translate refined parameters into effective locomotion control.

Authors

Institutions

Publication Details

Journal
Applied Sciences
Published
2026-11-19
DOI
https://doi.org/10.3390/app162211478
Primary Topic
Robotic Locomotion and Control
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Finite-Horizon Performance Estimation for Online Parameter Refinement in RL–MPC Quadrupedal Locomotion

Chengleng Han, Lin Xu
Applied Sciences
Robotic Locomotion and Control
article

Finite-Horizon Performance Estimation for Online Parameter Refinement in RL–MPC Quadrupedal Locomotion

Chengleng Han, Lin Xu
article en

Abstract

Reinforcement learning integrated with model predictive control (RL-MPC) enables adaptive quadrupedal locomotion, but learned controller parameters do not explicitly account for their subsequent closed-loop performance. This study proposes a finite-horizon performance estimator (FHPE) to guide online parameter refinement. Trained on rollout data, FHPE predicts the finite-horizon performance of local parameter candidates to guide constrained refinement of the nominal RL proposal. The refined parameters are implemented through MPC and Adaptive Impedance Modulation (AIM), while Transient Residual Compensation (TRC) regulates joint-level responses through spectral regularization and risk-dependent gating. Ablation studies show that FHPE-guided refinement reduces the combined performance cost by 12.68% compared with equal-budget search, while AIM and TRC improve execution performance and transient regulation. Robot performance evaluations demonstrate improved high-speed locomotion capability, an approximately 26% reduction in peak joint acceleration on uneven terrain, and an approximately 43% reduction in estimated mechanical work over 10 m on flat ground in hardware experiments. These findings suggest that finite-horizon performance prediction can improve online parameter selection, while joint-level adaptation helps translate refined parameters into effective locomotion control.

Applied SciencesVol. 16(22)
Wuhan University of Technology (CN)
Robotic Locomotion and Control
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon