When Vision Deceives: The Compensatory Role of Passive Haptics in Mitigating Sim2Real Gap During Teleoperation Assembly

In model-mediated teleoperation (MMT), network latency and sensor drift often cause discrepancies between visual rendering and actual physical states (the Sim2Real gap), compromising safety and increasing cognitive load. To investigate the compensatory role of kinesthetic feedback, this study developed a modular insertion platform incorporating 3D-printed physical proxiesand compared visual feedback (VF)with passive haptic feedback (PH) under deliberate visual registration errors across different difficulty levels. Analysis of 24 participants showed thatPH reduced command/penetration deviation and acceleratedexploratory procedures at medium-to-high difficulty levels, enhancing safety and efficiency. NASA-TLX and MPQ results showed reduced overall task load and enhanced presence for most operators. Exploratory outlier analysis identified two participants who appeared to rely more heavily on vision and experienced increased cognitive load under inflexible physical constraints.These findings provide empirical guidance for industrial MMT interface design.

Authors

Institutions

Publication Details

Journal
International Journal of Human-Computer Interaction
Published
2026-09-16
DOI
https://doi.org/10.1080/10447318.2026.2729216
Primary Topic
Teleoperation and Haptic Systems
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
article

When Vision Deceives: The Compensatory Role of Passive Haptics in Mitigating Sim2Real Gap During Teleoperation Assembly

Mark Billinghurst, Xiaotian Zhang, Jilong Bai, Haoran Zhang et al.
International Journal of Human-Computer Interaction
Teleoperation and Haptic Systems
article

When Vision Deceives: The Compensatory Role of Passive Haptics in Mitigating Sim2Real Gap During Teleoperation Assembly

Mark Billinghurst, Xiaotian Zhang, Jilong Bai, Haoran Zhang, Weiping He, Yunzhi Zhong
article en

Abstract

In model-mediated teleoperation (MMT), network latency and sensor drift often cause discrepancies between visual rendering and actual physical states (the Sim2Real gap), compromising safety and increasing cognitive load. To investigate the compensatory role of kinesthetic feedback, this study developed a modular insertion platform incorporating 3D-printed physical proxiesand compared visual feedback (VF)with passive haptic feedback (PH) under deliberate visual registration errors across different difficulty levels. Analysis of 24 participants showed thatPH reduced command/penetration deviation and acceleratedexploratory procedures at medium-to-high difficulty levels, enhancing safety and efficiency. NASA-TLX and MPQ results showed reduced overall task load and enhanced presence for most operators. Exploratory outlier analysis identified two participants who appeared to rely more heavily on vision and experienced increased cognitive load under inflexible physical constraints.These findings provide empirical guidance for industrial MMT interface design.

International Journal of Human-Computer Interaction
Northwestern Polytechnical University (CN), Shangluo University (CN), The University of Adelaide (AU)
Openalex Percentile: Top 20%
Teleoperation and Haptic Systems
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

When Vision Deceives: The Compensatory Role of Passive Haptics in Mitigating Sim2Real Gap During Teleoperation Assembly — Mark Billinghurst, Xiaotian Zhang, et al. · International Journal of Human-Computer Interaction (2026) | TGRS Research Map | TGRS