Whole-Body Teleoperation for Mobile Manipulation at Zero Added Cost

Demonstration data plays a key role in learning complex behaviors and training robotic foundation models. While effective control interfaces exist for static manipulators, data collection remains cumbersome and time intensive for mobile manipulators due to their large number of degrees of freedom. While specialized hardware, avatars, or motion tracking can enable whole-body control, these approaches are either expensive, robot-specific, or suffer from the embodiment mismatch between robot and human demonstrator. In this work, we present MoMa-Teleop, a novel teleoperation method that infers end-effector motions from existing interfaces and delegates the base motions to a previously developed reinforcement learning agent, leaving the operator to focus fully on the task-relevant end-effector motions. This enables whole-body teleoperation of mobile manipulators with no additional hardware or setup costs via standard interfaces such as joysticks or hand guidance. Moreover, the operator is not bound to a tracked workspace and can move freely with the robot over spatially extended tasks. We demonstrate that our approach results in a significant reduction in task completion time across a variety of robots and tasks. As the generated data covers diverse whole-body motions without embodiment mismatch, it enables efficient imitation learning. By focusing on task-specific end-effector motions, our approach learns skills that transfer to unseen settings, such as new obstacles or changed object positions, from as little as five demonstrations.

Authors

Institutions

Publication Details

Journal
IEEE Robotics and Automation Letters
Published
2025-02-10
DOI
https://doi.org/10.1109/lra.2025.3540582
Citations
3
Primary Topic
Teleoperation and Haptic Systems
Type
article
Field-Weighted Citation Impact
2.14
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Whole-Body Teleoperation for Mobile Manipulation at Zero Added Cost

Jan Ole von Hartz, Abhinav Valada, Daniel Honerkamp, Tim Welschehold et al.
3 citations
IEEE Robotics and Automation Letters
Teleoperation and Haptic Systems
2.14
article

Whole-Body Teleoperation for Mobile Manipulation at Zero Added Cost

Jan Ole von Hartz, Abhinav Valada, Daniel Honerkamp, Tim Welschehold, Harsh Mahesheka
article en
3 citations

Abstract

Demonstration data plays a key role in learning complex behaviors and training robotic foundation models. While effective control interfaces exist for static manipulators, data collection remains cumbersome and time intensive for mobile manipulators due to their large number of degrees of freedom. While specialized hardware, avatars, or motion tracking can enable whole-body control, these approaches are either expensive, robot-specific, or suffer from the embodiment mismatch between robot and human demonstrator. In this work, we present MoMa-Teleop, a novel teleoperation method that infers end-effector motions from existing interfaces and delegates the base motions to a previously developed reinforcement learning agent, leaving the operator to focus fully on the task-relevant end-effector motions. This enables whole-body teleoperation of mobile manipulators with no additional hardware or setup costs via standard interfaces such as joysticks or hand guidance. Moreover, the operator is not bound to a tracked workspace and can move freely with the robot over spatially extended tasks. We demonstrate that our approach results in a significant reduction in task completion time across a variety of robots and tasks. As the generated data covers diverse whole-body motions without embodiment mismatch, it enables efficient imitation learning. By focusing on task-specific end-effector motions, our approach learns skills that transfer to unseen settings, such as new obstacles or changed object positions, from as little as five demonstrations.

IEEE Robotics and Automation LettersVol. 10(4)
University of Freiburg (DE)
Openalex Percentile: Top 15%
Teleoperation and Haptic Systems
2.14
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Whole-Body Teleoperation for Mobile Manipulation at Zero Added Cost — Jan Ole von Hartz, Abhinav Valada, et al. · IEEE Robotics and Automation Letters (2025) | TGRS Research Map | TGRS