Research on human skeleton behavior recognition method based on GCN-Transformer hybrid network architecture
In response to the problem of insufficient global information extraction from human skeletons during the spatial domain modeling process based on Graph Convolutional Networks (GCN) for human skeleton behavior recognition , we have proposed a hybrid network architecture that integrates GCN and Transformer for human skeletal behavior recognition. Firstly, a hybrid network structure is designed, which combines the advantages of GCN in local feature extraction and Transformer in global information capture, enabling comprehensive and effective extraction of global and local spatial features from skeletal data. Secondly, a spatial feature interaction module is constructed to dynamically adjust attention information in space and time, better fusing global and local features. Finally, we constructed an end-to-end graph convolutional neural network model that significantly improved the stability and accuracy of behavior recognition by enhancing the information representation ability of spatio-temporal receptive fields. Verified on the public MSR Action 3D action recognition datasets, the recognition rate of the proposed algorithm reaches 96.75%, surpassing most existing action recognition technologies.
Authors
- Gang Mou
- Yichen Yang (ORCID: https://orcid.org/0000-0002-9402-4972)
- Yan Chen (ORCID: https://orcid.org/0000-0003-0570-8617)
- Yulin Wang (ORCID: https://orcid.org/0000-0002-3195-7978)
- Tao Song (ORCID: https://orcid.org/0000-0001-7412-7336)
Institutions
- Chongqing Vocational Institute of Engineering (CN)
- Chongqing University of Technology (CN)
Publication Details
- Published
- 2025-07-16
- DOI
- https://doi.org/10.1117/12.3070650
- Primary Topic
- Advanced Computing and Algorithms
- Type
- article
- Field-Weighted Citation Impact
- 0.00