Feature-Fused Deep Learning Approach for Hand Gesture Recognition in Intelligent Myoelectric Hand
Accurate and efficient hand gesture recognition is a cornerstone for advancing the functionality of myoelectric prostheses, enabling intuitive and responsive human-machine interaction. In this study, we present a novel hybrid deep learning architecture that synergistically integrates convolutional neural networks (CNNs) with Transformer models to achieve unprecedented accuracy in electromyogram (EMG)-based hand gesture classification. By leveraging advanced feature engineering, we extract and combine time-domain, frequency-domain, and time-frequency features to provide a comprehensive representation of muscle activity patterns. This approach addresses critical challenges in existing methods, such as poor generalization and limited robustness to subject variability. The proposed system achieves a state-of-the-art recognition accuracy of 98.5% and an F1-score of 0.98 across 12 distinct hand gestures, surpassing existing methodologies. Additionally, we validate the practicality of our system by implementing it in a real-time control platform for a myoelectric hand, demonstrating its capability to perform precise, real-world motor tasks. Our findings represent a significant step forward in neural systems and rehabilitation engineering, offering a transformative solution for enhancing the usability and functionality of intelligent myoelectric prostheses.
Authors
- Haohua Xiu (ORCID: https://orcid.org/0000-0002-7821-125X)
- Yuyang Wei (ORCID: https://orcid.org/0000-0002-3200-8598)
- Luzheng Bi (ORCID: https://orcid.org/0000-0001-8986-3379)
- Zhihong Zhang (ORCID: https://orcid.org/0000-0001-5935-1567)
- Lingyun Yan (ORCID: https://orcid.org/0000-0002-9986-2182)
Institutions
- Beijing Institute of Technology (CN)
- Jilin University (CN)
- University of Oxford (GB)
- Shanghai Institute of Technology (CN)
Publication Details
- Journal
- IEEE Sensors Journal
- Published
- 2025-05-20
- DOI
- https://doi.org/10.1109/jsen.2025.3570236
- Primary Topic
- Hand Gesture Recognition Systems
- Type
- article
- Field-Weighted Citation Impact
- 0.00