A hybrid AI vision model for single-camera tracking of rehabilitation exercises: a proof of concept in clinical settings

Accurate measurement of range of motion (ROM) during physical rehabilitation is traditionally achieved using goniometers or multi-camera, marker-based motion capture systems. The latter, while highly accurate, require specialised laboratory infrastructure, are costly, and are unsuitable for home-based use. There is growing interest in markerless, camera-based alternatives that leverage artificial intelligence (AI) for joint angle estimation. This study presents a preliminary proof-of-concept evaluation of a hybrid AI vision system, combining the MediaPipe Pose framework (version 0.8.9.1, Full model variant) with a Mamdani-type fuzzy inference system, for joint angle estimation and exercise repetition counting using a single consumer-grade camera. Fourteen healthy adult rehabilitation staff members performed three exercises (elbow flexion, knee extension, and hip external rotation) simultaneously recorded by the proposed AI system and by a reference optical motion capture system (C-Motion Visual3D™, 14 calibrated infrared cameras, 53 retro-reflective markers). Reliability was assessed using two-way mixed-effects intraclass correlation coefficients (ICC[Formula: see text]) with absolute agreement. Individual-measure ICC values ranged from poor to good across joints and conditions (range: 0.005-0.68). The highest reliability was observed for the right hip external rotation ROM (individual ICC [Formula: see text]; average ICC [Formula: see text], 95% CI: 0.63-0.89). Several measures showed poor reliability, including the right elbow flexion ROM (individual ICC [Formula: see text]) and the minimum angle of the left hip external rotation (individual ICC [Formula: see text]). Confidence intervals were wide throughout. This proof of concept demonstrates that a single-camera AI system can capture general trends in joint angles during simple rehabilitation exercises in healthy adults under controlled conditions. However, reliability is inconsistent and frequently poor, and the system has not been evaluated in patient populations with pathological movement patterns. These findings do not support clinical deployment at this stage. Substantial further development and validation in patient cohorts are required before clinical or home-based use can be considered.

Authors

Institutions

Publication Details

Journal
Scientific Reports
Published
2026-05-29
DOI
https://doi.org/10.1038/s41598-026-55431-x
Primary Topic
Stroke Rehabilitation and Recovery
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A hybrid AI vision model for single-camera tracking of rehabilitation exercises: a proof of concept in clinical settings

Utpal Chandra Das, Pasu Kaewplung, Surachai Chaitusaney, Watit Benjapolakul et al.
Scientific Reports
Stroke Rehabilitation and Recovery
article

A hybrid AI vision model for single-camera tracking of rehabilitation exercises: a proof of concept in clinical settings

Utpal Chandra Das, Pasu Kaewplung, Surachai Chaitusaney, Watit Benjapolakul, Chatkaew Pongmala, Ngoc Thien Le, Timporn Vitoonpong, Chalermdej Prapinpairoj, Kawee Anannub
article en

Abstract

Accurate measurement of range of motion (ROM) during physical rehabilitation is traditionally achieved using goniometers or multi-camera, marker-based motion capture systems. The latter, while highly accurate, require specialised laboratory infrastructure, are costly, and are unsuitable for home-based use. There is growing interest in markerless, camera-based alternatives that leverage artificial intelligence (AI) for joint angle estimation. This study presents a preliminary proof-of-concept evaluation of a hybrid AI vision system, combining the MediaPipe Pose framework (version 0.8.9.1, Full model variant) with a Mamdani-type fuzzy inference system, for joint angle estimation and exercise repetition counting using a single consumer-grade camera. Fourteen healthy adult rehabilitation staff members performed three exercises (elbow flexion, knee extension, and hip external rotation) simultaneously recorded by the proposed AI system and by a reference optical motion capture system (C-Motion Visual3D™, 14 calibrated infrared cameras, 53 retro-reflective markers). Reliability was assessed using two-way mixed-effects intraclass correlation coefficients (ICC[Formula: see text]) with absolute agreement. Individual-measure ICC values ranged from poor to good across joints and conditions (range: 0.005-0.68). The highest reliability was observed for the right hip external rotation ROM (individual ICC [Formula: see text]; average ICC [Formula: see text], 95% CI: 0.63-0.89). Several measures showed poor reliability, including the right elbow flexion ROM (individual ICC [Formula: see text]) and the minimum angle of the left hip external rotation (individual ICC [Formula: see text]). Confidence intervals were wide throughout. This proof of concept demonstrates that a single-camera AI system can capture general trends in joint angles during simple rehabilitation exercises in healthy adults under controlled conditions. However, reliability is inconsistent and frequently poor, and the system has not been evaluated in patient populations with pathological movement patterns. These findings do not support clinical deployment at this stage. Substantial further development and validation in patient cohorts are required before clinical or home-based use can be considered.

Scientific Reports
Chulalongkorn University (TH), Queensland University of Technology (AU), University of Michigan (US), King Chulalongkorn Memorial Hospital (TH), Michigan Medicine (US)
Openalex Percentile: Top 8%
Stroke Rehabilitation and Recovery
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.