Active Vision for Visuomotor Policy Generalization Under Positional Variations
Abstract In recent years, visuomotor policy learning has gained increased attention in the robotics domain. Ideally, such policies enable robots to generate actions directly from observations with high efficiency and accuracy. In reality, performance is significantly degraded when the robot encounters previously unseen environments (e.g., a novel position of an object to grasp, disturbances in the camera viewpoint). Several studies have attempted to deal with this problem by training the model on large-scale datasets, but constructing such datasets raises another challenge of data efficiency. To address these limitations, this work presents a data-efficient visuomotor policy framework via active vision. To be specific, the proposed framework employs an object detection algorithm and expresses the robot state and actions in terms of the camera coordinate frame. Provided that the camera viewpoint is properly adjusted by active vision, the visuomotor policy can manipulate objects at any position, even at positions not included in the training data. The experiments performed in both simulation and real-world environments with a humanoid robot and a dual manipulator system highlight that the proposed framework outperforms the state-of-the-art approaches significantly by enhancing the success rate for the pick-and-place task at unseen object positions from 45 to 91%.
Authors
- Jaeheung Park (ORCID: https://orcid.org/0000-0002-5062-8264)
- Haeseong Lee (ORCID: https://orcid.org/0000-0003-3005-4790)
- Woo-Jeong Baek (ORCID: https://orcid.org/0000-0002-1781-329X)
- Yonghee Lee
- Junheon Yoon
Institutions
- Seoul National University (KR)
- Hyundai Motor Group (South Korea) (KR)
- Advanced Institute of Convergence Technology (KR)
Publication Details
- Journal
- International Journal of Control Automation and Systems
- Published
- 2026-11-17
- DOI
- https://doi.org/10.1007/s12555-026-00237-w
- Primary Topic
- Robot Manipulation and Learning
- Type
- article
- Field-Weighted Citation Impact
- 0.00