Active Vision for Visuomotor Policy Generalization Under Positional Variations

Abstract In recent years, visuomotor policy learning has gained increased attention in the robotics domain. Ideally, such policies enable robots to generate actions directly from observations with high efficiency and accuracy. In reality, performance is significantly degraded when the robot encounters previously unseen environments (e.g., a novel position of an object to grasp, disturbances in the camera viewpoint). Several studies have attempted to deal with this problem by training the model on large-scale datasets, but constructing such datasets raises another challenge of data efficiency. To address these limitations, this work presents a data-efficient visuomotor policy framework via active vision. To be specific, the proposed framework employs an object detection algorithm and expresses the robot state and actions in terms of the camera coordinate frame. Provided that the camera viewpoint is properly adjusted by active vision, the visuomotor policy can manipulate objects at any position, even at positions not included in the training data. The experiments performed in both simulation and real-world environments with a humanoid robot and a dual manipulator system highlight that the proposed framework outperforms the state-of-the-art approaches significantly by enhancing the success rate for the pick-and-place task at unseen object positions from 45 to 91%.

Authors

Institutions

Publication Details

Journal
International Journal of Control Automation and Systems
Published
2026-11-17
DOI
https://doi.org/10.1007/s12555-026-00237-w
Primary Topic
Robot Manipulation and Learning
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Active Vision for Visuomotor Policy Generalization Under Positional Variations

Jaeheung Park, Haeseong Lee, Woo-Jeong Baek, Yonghee Lee et al.
International Journal of Control Automation and Systems
Robot Manipulation and Learning
article

Active Vision for Visuomotor Policy Generalization Under Positional Variations

Jaeheung Park, Haeseong Lee, Woo-Jeong Baek, Yonghee Lee, Junheon Yoon
article en

Abstract

Abstract In recent years, visuomotor policy learning has gained increased attention in the robotics domain. Ideally, such policies enable robots to generate actions directly from observations with high efficiency and accuracy. In reality, performance is significantly degraded when the robot encounters previously unseen environments (e.g., a novel position of an object to grasp, disturbances in the camera viewpoint). Several studies have attempted to deal with this problem by training the model on large-scale datasets, but constructing such datasets raises another challenge of data efficiency. To address these limitations, this work presents a data-efficient visuomotor policy framework via active vision. To be specific, the proposed framework employs an object detection algorithm and expresses the robot state and actions in terms of the camera coordinate frame. Provided that the camera viewpoint is properly adjusted by active vision, the visuomotor policy can manipulate objects at any position, even at positions not included in the training data. The experiments performed in both simulation and real-world environments with a humanoid robot and a dual manipulator system highlight that the proposed framework outperforms the state-of-the-art approaches significantly by enhancing the success rate for the pick-and-place task at unseen object positions from 45 to 91%.

International Journal of Control Automation and Systems
Seoul National University (KR), Hyundai Motor Group (South Korea) (KR), Advanced Institute of Convergence Technology (KR)
Robot Manipulation and Learning
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon