Evaluation of markerless hand-tracking accuracy in VR application designed for hand range-of-motion measurement and rehabilitation

Abstract Background Virtual reality offers new opportunities for the objective assessment and training of hand function during rehabilitation. However, the reliability of performance metrics depends on the accuracy and stability of hand tracking. This study evaluates thumb-finger distance measurement in a virtual reality application designed for hand range-of-motion measurement and rehabilitation by comparing native Meta Quest hand tracking with MediaPipe. The comparison was designed as a technical pilot assessment rather than a population-level validation. Methods The protocol comprised a static head-to-head comparison between Meta Quest and MediaPipe and a separate dynamic orientation analysis conducted using Meta Quest only. The core comparison involved one healthy right-handed male participant aged 25 years. Static tests for both tracking approaches were performed at reference distances of 5, 10, and 15 cm verified with a digital caliper, whereas the Meta Quest dynamic tests used a 10 cm reference during full rotations and half rotations in palm-facing and dorsum-facing sectors. Results Differential-error analysis showed that the reproduction of reference-distance changes depended on hand-finger configuration. In the static cross-system comparison, Meta Quest showed lower MAE in 23 of the 24 matched static configurations and higher median tolerance-band coverage than the tested MediaPipe pipeline, while MediaPipe was more susceptible to occlusion and landmark-assignment errors. A separate Meta Quest dynamic analysis demonstrated orientation-dependent changes in tracking performance. An exploratory extension involving five additional healthy male students aged 18–24 years provided descriptive multi-user context and revealed between-subject variability, particularly in dynamic conditions. Conclusions Native Meta Quest tracking appears more suitable than MediaPipe for distance-based VR hand rehabilitation applications under the tested conditions. The findings represent technical validation of relative thumb–fingertip distance measurement and should not be interpreted as clinical validation or absolute 3D positional validation. These findings support further technical development and evaluation of native headset-based hand tracking for adaptive VR systems and provide practical guidance for reducing tracking errors and standardizing the reporting of performance metrics in rehabilitation-oriented VR environments.

Authors

Institutions

Publication Details

Journal
Journal of NeuroEngineering and Rehabilitation
Published
2026-11-06
DOI
https://doi.org/10.1186/s12984-026-02203-3
Primary Topic
Hand Gesture Recognition Systems
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Evaluation of markerless hand-tracking accuracy in VR application designed for hand range-of-motion measurement and rehabilitation

Krzysztof Sibilski, Jan Klimaszewski, Edyta Ładyżyńska-Kozdraś, Marta Grzyb et al.
3 links
Journal of NeuroEngineering and Rehabilitation
Hand Gesture Recognition Systems
article

Evaluation of markerless hand-tracking accuracy in VR application designed for hand range-of-motion measurement and rehabilitation

Krzysztof Sibilski, Jan Klimaszewski, Edyta Ładyżyńska-Kozdraś, Marta Grzyb, Jakub Kowalczyk, Anna Sibilska
article en

Abstract

Abstract Background Virtual reality offers new opportunities for the objective assessment and training of hand function during rehabilitation. However, the reliability of performance metrics depends on the accuracy and stability of hand tracking. This study evaluates thumb-finger distance measurement in a virtual reality application designed for hand range-of-motion measurement and rehabilitation by comparing native Meta Quest hand tracking with MediaPipe. The comparison was designed as a technical pilot assessment rather than a population-level validation. Methods The protocol comprised a static head-to-head comparison between Meta Quest and MediaPipe and a separate dynamic orientation analysis conducted using Meta Quest only. The core comparison involved one healthy right-handed male participant aged 25 years. Static tests for both tracking approaches were performed at reference distances of 5, 10, and 15 cm verified with a digital caliper, whereas the Meta Quest dynamic tests used a 10 cm reference during full rotations and half rotations in palm-facing and dorsum-facing sectors. Results Differential-error analysis showed that the reproduction of reference-distance changes depended on hand-finger configuration. In the static cross-system comparison, Meta Quest showed lower MAE in 23 of the 24 matched static configurations and higher median tolerance-band coverage than the tested MediaPipe pipeline, while MediaPipe was more susceptible to occlusion and landmark-assignment errors. A separate Meta Quest dynamic analysis demonstrated orientation-dependent changes in tracking performance. An exploratory extension involving five additional healthy male students aged 18–24 years provided descriptive multi-user context and revealed between-subject variability, particularly in dynamic conditions. Conclusions Native Meta Quest tracking appears more suitable than MediaPipe for distance-based VR hand rehabilitation applications under the tested conditions. The findings represent technical validation of relative thumb–fingertip distance measurement and should not be interpreted as clinical validation or absolute 3D positional validation. These findings support further technical development and evaluation of native headset-based hand tracking for adaptive VR systems and provide practical guidance for reducing tracking errors and standardizing the reporting of performance metrics in rehabilitation-oriented VR environments.

Journal of NeuroEngineering and Rehabilitation
Warsaw University of Technology (PL), Kielce University of Technology (PL)
Good health and well-being
Openalex Percentile: Top 14%
Hand Gesture Recognition Systems
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon