Innovative application of neural networks hybrid model based on attention mechanism in natural human-computer gesture interaction
In order to improve the natural interaction ability of quadruped robots, this study proposes a hybrid model (CNN-LSTM-AM) that integrates convolutional neural networks (CNN), long short-term memory networks (LSTM) and attention mechanisms (AM). By improving the infrared sensor data acquisition method (APDS9960 sensor) and optimizing the data set (Net4uCA enhanced set), combined with a deep learning framework, efficient recognition of dynamic gestures is achieved. Experimental results show that the model has an average recognition accuracy of 99% on 1,350 data sets containing 9 types of gestures, which is significantly better than single CNN (92%) and LSTM (88%) models. The innovative introduction of a time step dynamic weight adjustment mechanism effectively captures the global dependencies of time series data and provides technical support for complex human-computer interaction scenarios.
Authors
- Jian Yu (ORCID: https://orcid.org/0000-0001-6824-064X)
- Bingxuan Li (ORCID: https://orcid.org/0000-0002-8062-0730)
- Zekai Xu (ORCID: https://orcid.org/0000-0002-8462-574X)
- Zhenhao Li (ORCID: https://orcid.org/0009-0006-0287-9188)
- Yifen Mu (ORCID: https://orcid.org/0000-0001-6478-6928)
Institutions
- Nanyang Normal University (CN)
- CRRC (China) (CN)
Publication Details
- Published
- 2025-08-11
- DOI
- https://doi.org/10.1117/12.3072599
- Primary Topic
- Educational Technology and Pedagogy
- Type
- article
- Field-Weighted Citation Impact
- 0.00