Minimizing redundancy in hand dynamic features for enhanced sign language recognition
This paper presents a wavelet-based framework for 3-D sign language recognition that outperforms conventional ZCA approaches by preserving critical spatiotemporal relationships in hand kinematics. We formulate hand dynamics as a wavelet exponent energy problem using Daubechies transforms, where joint coordinates, mother coefficients, and window sizes are jointly optimized, avoiding PCA’s disruptive axis rotation while maintaining interpretable feature orientations. The proposed method combines this wavelet energy representation with an ensemble deep learning feature selection layer using binary masking ( <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML" display="inline" overflow="scroll"> <mml:msub> <mml:mi>λ</mml:mi> <mml:mn>1</mml:mn> </mml:msub> <mml:mo>=</mml:mo> <mml:mn>0.10</mml:mn> </mml:math> , <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML" display="inline" overflow="scroll"> <mml:msub> <mml:mi>λ</mml:mi> <mml:mn>2</mml:mn> </mml:msub> <mml:mo>=</mml:mo> <mml:mn>0.01</mml:mn> </mml:math> ) and regularization to eliminate redundancy, achieving 94.09% accuracy (vs. 92.75% for PCC+ZCA (SVD)) with 4.3 <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML" display="inline" overflow="scroll"> <mml:mo>×</mml:mo> </mml:math> faster inference on Turkish SL datasets. Statistical validation (ANOVA, <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML" display="inline" overflow="scroll"> <mml:mi>p</mml:mi> <mml:mo><</mml:mo> <mml:mn>0.001</mml:mn> </mml:math> ) confirms significant improvements over ZCA-derived features ( <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML" display="inline" overflow="scroll"> <mml:mi>t</mml:mi> <mml:mo>=</mml:mo> <mml:mn>24.15</mml:mn> </mml:math> ), with weight analysis revealing proximal arm kinematics as dominant recognition factors. The framework’s computational efficiency (0.12ms inference) and preservation of kinematic relationships demonstrate its superiority for real-life SLR applications compared to both PCC and ZCA approaches.
Authors
- Sunusi Bala Abdullahi (ORCID: https://orcid.org/0000-0003-1898-7352)
- Verónica Bolón‐Canedo (ORCID: https://orcid.org/0000-0002-0524-6427)
Institutions
- Sakarya University (TR)
- Universidade da Coruña (ES)
Publication Details
- Journal
- Intelligent Data Analysis
- Published
- 2025-11-05
- DOI
- https://doi.org/10.1177/1088467x251367228
- Primary Topic
- Hand Gesture Recognition Systems
- Type
- article
- Field-Weighted Citation Impact
- 0.00