Sensor Fusion-Based Smart Glove for Deterministic Sign Language Recognition: An IoT-Enabled System

Wearable technologies offer practical opportunities for assistive communication and educational support in introductory sign language learning. This paper presents an IoT-enabled smart glove for deterministic static sign language recognition over a bounded vocabulary of 15 isolated static gestures, comprising digits (0–9) and five vowel handshapes (A, E, I, O, U). The system is intended for foundational static gesture and posture practice and is not designed or validated for dynamic gestures, coarticulated signing, continuous sign language recognition, or sentence-level translation. The prototype integrates five 2.2-inch (55.9 mm) resistive flex sensors and an MPU6050 3-axis accelerometer, performs acquisition, exponential moving average filtering, user-specific calibration, normalization, and deterministic classification on a NodeMCU ESP32 board, and transmits selected processed variables to Arduino Cloud through MQTT for remote monitoring. A 10 s calibration routine maps user-specific open-hand and closed-fist responses into normalized flex-sensor ranges, allowing the same deterministic rule structure to operate across participants without model retraining. Experimental evaluation with 10 healthy adult participants aged 20–41 years (mean age: 27 years), all familiar with sign language and all providing written informed consent, produced a balanced dataset of 1500 labeled steady-state sensor vectors. The class-averaged recognition rate was 92.8%, and leave-one-subject-out validation produced a subject-wise accuracy of 92.80±2.03%, with individual participant accuracies ranging from 90.00% to 96.00%. The local embedded processing pipeline required less than 2 ms per cycle, the complete path including MQTT visualization produced approximately 150 ms end-to-end latency, and the device operated for up to 14 h using a 3.7 V, 1000 mAh Li-Po battery. The results indicate that calibrated deterministic sensor fusion can provide a low-cost, low-latency, edge-executed solution for bounded static sign-language gesture learning tasks while maintaining stable short-term subject-wise performance under controlled experimental conditions.

Authors

Institutions

Publication Details

Journal
Technologies
Published
2026-06-18
DOI
https://doi.org/10.3390/technologies14060371
Primary Topic
Hand Gesture Recognition Systems
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Sensor Fusion-Based Smart Glove for Deterministic Sign Language Recognition: An IoT-Enabled System

Byron Gustavo Loarte Cajamarca, Alan Cuenca Sánchez, Leandro Antonio Pazmiño Ortiz, María G. Pérez
Technologies
Hand Gesture Recognition Systems
article

Sensor Fusion-Based Smart Glove for Deterministic Sign Language Recognition: An IoT-Enabled System

Byron Gustavo Loarte Cajamarca, Alan Cuenca Sánchez, Leandro Antonio Pazmiño Ortiz, María G. Pérez
article en

Abstract

Wearable technologies offer practical opportunities for assistive communication and educational support in introductory sign language learning. This paper presents an IoT-enabled smart glove for deterministic static sign language recognition over a bounded vocabulary of 15 isolated static gestures, comprising digits (0–9) and five vowel handshapes (A, E, I, O, U). The system is intended for foundational static gesture and posture practice and is not designed or validated for dynamic gestures, coarticulated signing, continuous sign language recognition, or sentence-level translation. The prototype integrates five 2.2-inch (55.9 mm) resistive flex sensors and an MPU6050 3-axis accelerometer, performs acquisition, exponential moving average filtering, user-specific calibration, normalization, and deterministic classification on a NodeMCU ESP32 board, and transmits selected processed variables to Arduino Cloud through MQTT for remote monitoring. A 10 s calibration routine maps user-specific open-hand and closed-fist responses into normalized flex-sensor ranges, allowing the same deterministic rule structure to operate across participants without model retraining. Experimental evaluation with 10 healthy adult participants aged 20–41 years (mean age: 27 years), all familiar with sign language and all providing written informed consent, produced a balanced dataset of 1500 labeled steady-state sensor vectors. The class-averaged recognition rate was 92.8%, and leave-one-subject-out validation produced a subject-wise accuracy of 92.80±2.03%, with individual participant accuracies ranging from 90.00% to 96.00%. The local embedded processing pipeline required less than 2 ms per cycle, the complete path including MQTT visualization produced approximately 150 ms end-to-end latency, and the device operated for up to 14 h using a 3.7 V, 1000 mAh Li-Po battery. The results indicate that calibrated deterministic sensor fusion can provide a low-cost, low-latency, edge-executed solution for bounded static sign-language gesture learning tasks while maintaining stable short-term subject-wise performance under controlled experimental conditions.

TechnologiesVol. 14(6)
National Polytechnic School (EC)
Quality Education
Openalex Percentile: Top 4%
Hand Gesture Recognition Systems
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.