Research on human skeleton behavior recognition method based on GCN-Transformer hybrid network architecture

In response to the problem of insufficient global information extraction from human skeletons during the spatial domain modeling process based on Graph Convolutional Networks (GCN) for human skeleton behavior recognition , we have proposed a hybrid network architecture that integrates GCN and Transformer for human skeletal behavior recognition. Firstly, a hybrid network structure is designed, which combines the advantages of GCN in local feature extraction and Transformer in global information capture, enabling comprehensive and effective extraction of global and local spatial features from skeletal data. Secondly, a spatial feature interaction module is constructed to dynamically adjust attention information in space and time, better fusing global and local features. Finally, we constructed an end-to-end graph convolutional neural network model that significantly improved the stability and accuracy of behavior recognition by enhancing the information representation ability of spatio-temporal receptive fields. Verified on the public MSR Action 3D action recognition datasets, the recognition rate of the proposed algorithm reaches 96.75%, surpassing most existing action recognition technologies.

Authors

Institutions

Publication Details

Published
2025-07-16
DOI
https://doi.org/10.1117/12.3070650
Primary Topic
Advanced Computing and Algorithms
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Research on human skeleton behavior recognition method based on GCN-Transformer hybrid network architecture

Gang Mou, Yichen Yang, Yan Chen, Yulin Wang et al.
Advanced Computing and Algorithms
article

Research on human skeleton behavior recognition method based on GCN-Transformer hybrid network architecture

Gang Mou, Yichen Yang, Yan Chen, Yulin Wang, Tao Song
article en

Abstract

In response to the problem of insufficient global information extraction from human skeletons during the spatial domain modeling process based on Graph Convolutional Networks (GCN) for human skeleton behavior recognition , we have proposed a hybrid network architecture that integrates GCN and Transformer for human skeletal behavior recognition. Firstly, a hybrid network structure is designed, which combines the advantages of GCN in local feature extraction and Transformer in global information capture, enabling comprehensive and effective extraction of global and local spatial features from skeletal data. Secondly, a spatial feature interaction module is constructed to dynamically adjust attention information in space and time, better fusing global and local features. Finally, we constructed an end-to-end graph convolutional neural network model that significantly improved the stability and accuracy of behavior recognition by enhancing the information representation ability of spatio-temporal receptive fields. Verified on the public MSR Action 3D action recognition datasets, the recognition rate of the proposed algorithm reaches 96.75%, surpassing most existing action recognition technologies.

Chongqing Vocational Institute of Engineering (CN), Chongqing University of Technology (CN)
Openalex Percentile: Top 77%
Advanced Computing and Algorithms
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Research on human skeleton behavior recognition method based on GCN-Transformer hybrid network architecture — Gang Mou, Yichen Yang, et al. · (2025) | TGRS Research Map | TGRS