Zero-HLM: Generalizable Humanoid Loco-Manipulation without Real Robot Data
Learning generalizable humanoid loco-manipulation remains bottlenecked by costly real-world demonstrations. Simulation provides a scalable alternative, but requires visually faithful, physics-ready scenes and executable whole-body motions. We present Zero-HLM, a real-to-sim-to-real framework that transforms smartphone captures and simulated source demonstrations into scalable training data for humanoid loco-manipulation. Gaussian-guided agentic real-to-sim reconstruction aligns visual and physical scenes; motion-environment co-adaptation uses rollout feedback to correct whole-body references and interaction geometry. We generate 4,800 physically validated demonstrations for zero-shot transfer across three Unitree G1 tasks. Simulation-trained GR00T N1.7 achieves 66.7% mean full-task success, versus 46.7% with real-data training. On generalized configurations, expanded simulation training raises pooled success from 23% for base-trained real-data policies to 69%, without additional real demonstrations. Project page: https://young-bit.github.io/zero-hlm/
Authors
- Dianyi Yang (ORCID: https://orcid.org/0009-0003-4236-3037)
- Baoxiong Jia (ORCID: https://orcid.org/0000-0002-4968-3290)
- Weiqi Huang
- Siyuan Huang
- Yixuan Li
- Wei Liang
- Zhumei Wang
- Mengya Liu
- Yu Liu
- Xiaochen Zhang
- Yuhang Yang
- Le Ma
Publication Details
- Journal
- arXiv (Cornell University)
- Published
- 2026-10-26
- DOI
- https://doi.org/10.48550/arxiv.2610.35075
- Primary Topic
- Reinforcement Learning in Robotics
- Type
- preprint