VM-BHINet:Vision Mamba Bimanual Hand Interaction Network for 3D Interacting Hand Mesh Recovery From a Single RGB Image

Understanding bimanual hand interactions is essential for realistic 3D pose and shape reconstruction. However, existing methods struggle with occlusions, ambiguous appearances, and computational inefficiencies. To address these challenges, we propose Vision Mamba Bimanual Hand Interaction Network (VM-BHINet), introducing state space models (SSMs) into hand reconstruction to enhance interaction modeling while improving computational efficiency. The core component, Vision Mamba Interaction Feature Extraction Block (VM-IFEBlock), combines SSMs with local and global feature operations, enabling deep understanding of hand interactions. Experiments on the InterHand2.6M dataset show that VM-BHINet reduces Mean per-joint position error (MPJPE) and Mean per-vertex position error (MPVPE) by 2-3 \(\%\) , significantly surpassing state-of-the-art methods.

Authors

Institutions

Publication Details

Journal
Proceedings of the ACM on Computer Graphics and Interactive Techniques
Published
2025-05-22
DOI
https://doi.org/10.1145/3728308
Citations
3
Primary Topic
Hand Gesture Recognition Systems
Type
article
Field-Weighted Citation Impact
5.81
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

VM-BHINet:Vision Mamba Bimanual Hand Interaction Network for 3D Interacting Hand Mesh Recovery From a Single RGB Image

Zijie Zheng, Yu He, Ge Yu, Wenzhuo Liu et al.
3 citations
Proceedings of the ACM on Computer Graphics and Interactive Techniques
Hand Gesture Recognition Systems
5.81
article

VM-BHINet:Vision Mamba Bimanual Hand Interaction Network for 3D Interacting Hand Mesh Recovery From a Single RGB Image

Zijie Zheng, Yu He, Ge Yu, Wenzhuo Liu, Han Bi
article en
3 citations

Abstract

Understanding bimanual hand interactions is essential for realistic 3D pose and shape reconstruction. However, existing methods struggle with occlusions, ambiguous appearances, and computational inefficiencies. To address these challenges, we propose Vision Mamba Bimanual Hand Interaction Network (VM-BHINet), introducing state space models (SSMs) into hand reconstruction to enhance interaction modeling while improving computational efficiency. The core component, Vision Mamba Interaction Feature Extraction Block (VM-IFEBlock), combines SSMs with local and global feature operations, enabling deep understanding of hand interactions. Experiments on the InterHand2.6M dataset show that VM-BHINet reduces Mean per-joint position error (MPJPE) and Mean per-vertex position error (MPVPE) by 2-3 \(\%\) , significantly surpassing state-of-the-art methods.

Proceedings of the ACM on Computer Graphics and Interactive TechniquesVol. 8(1)
Beijing Institute of Technology (CN), Technology and Engineering Center for Space Utilization (CN), University of Chinese Academy of Sciences (CN)
Openalex Percentile: Top 5%
Hand Gesture Recognition Systems
5.81
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

VM-BHINet:Vision Mamba Bimanual Hand Interaction Network for 3D Interacting Hand Mesh Recovery From a Single RGB Image — Zijie Zheng, Yu He, et al. · Proceedings of the ACM on Computer Graphics and Interactive Techniques (2025) | TGRS Research Map | TGRS