Learning from Incomplete Gestures: Robust Arabic Sign Language Recognition Under Missing Hand Detections

Hand-landmark recognition can be disrupted when a tracking system briefly loses sight of a hand, especially during fast movements or occlusion. This study examines practical ways to handle those missing observations using a lightweight bidirectional LSTM and a 30-class subset of KArSL-502 (1,928 sequences from three signers). We sampled 24 frames per sequence and simulated the removal of 10–40% of previously detected hand-frame observations, either at random or in consecutive bursts. We then compared three approaches: zero filling, non-causal temporal interpolation, and mask-aware learning. In the original training run, the classifier achieved 92.58% accuracy on unmodified test sequences. With 40% random removal, accuracy dropped to 74.68% using zero filling, but reached 91.90% with interpolation and 90.34% with mask-aware learning. Under burst removal, the corresponding results were 72.25%, 89.65%, and 86.31%. A separate evaluation across three training seeds showed the same overall pattern: at 40% removal, mean accuracy was 73.09%, 93.25%, and 90.69% for random gaps, and 70.27%, 90.57%, and 88.16% for burst gaps, respectively. Paired bootstrap analyses with a fixed test mask also indicated improvements over zero filling for both recovery methods. These findings show that relatively simple handling of missing landmarks can substantially improve robustness in this controlled setting. They do not, however, establish signer-independent performance or unrestricted real-time operation.

Authors

Publication Details

Journal
Preprints.org
Published
2026-11-12
DOI
https://doi.org/10.20944/preprints202611.1266.v1
Primary Topic
Hand Gesture Recognition Systems
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

Learning from Incomplete Gestures: Robust Arabic Sign Language Recognition Under Missing Hand Detections

Ahmad Abdelrahman
Preprints.org
Hand Gesture Recognition Systems
preprint

Learning from Incomplete Gestures: Robust Arabic Sign Language Recognition Under Missing Hand Detections

Ahmad Abdelrahman
preprint en

Abstract

Hand-landmark recognition can be disrupted when a tracking system briefly loses sight of a hand, especially during fast movements or occlusion. This study examines practical ways to handle those missing observations using a lightweight bidirectional LSTM and a 30-class subset of KArSL-502 (1,928 sequences from three signers). We sampled 24 frames per sequence and simulated the removal of 10–40% of previously detected hand-frame observations, either at random or in consecutive bursts. We then compared three approaches: zero filling, non-causal temporal interpolation, and mask-aware learning. In the original training run, the classifier achieved 92.58% accuracy on unmodified test sequences. With 40% random removal, accuracy dropped to 74.68% using zero filling, but reached 91.90% with interpolation and 90.34% with mask-aware learning. Under burst removal, the corresponding results were 72.25%, 89.65%, and 86.31%. A separate evaluation across three training seeds showed the same overall pattern: at 40% removal, mean accuracy was 73.09%, 93.25%, and 90.69% for random gaps, and 70.27%, 90.57%, and 88.16% for burst gaps, respectively. Paired bootstrap analyses with a fixed test mask also indicated improvements over zero filling for both recovery methods. These findings show that relatively simple handling of missing landmarks can substantially improve robustness in this controlled setting. They do not, however, establish signer-independent performance or unrestricted real-time operation.

Preprints.org
Hand Gesture Recognition Systems
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon