Human skeleton action recognition based on feature-enhanced spatiotemporal graph convolutional network

In recent years, deep learning-based human skeleton action recognition technology has seen significant development and application in areas such as human-computer interaction, security monitoring, and rehabilitation medicine. To address the issue of insufficient exploitation of spatiotemporal features in skeleton action recognition, this paper designs a Spatiotemporal Graph Convolutional Network with feature enhancement. This network enhances features from the perspectives of nodes, space, and time to improve the accuracy of skeleton action recognition. Firstly, by connecting graphs of adjacent frames to construct local spatiotemporal graphs, the network achieves a more comprehensive capture of spatial and temporal dependencies. Next, in the spatial graph convolution operations, self-attention mechanisms and channel attention modules are used to learn separate topological structures for different time frames, allowing the model to capture complex changes in human body structure across various time frames. Finally, in the temporal convolution stage, the use of multi-scale convolutional kernels enhances the perception of features across different temporal domains. This human skeleton action recognition model demonstrates efficient spatiotemporal feature extraction capabilities and excellent performance.

Authors

Institutions

Publication Details

Published
2024-09-13
DOI
https://doi.org/10.1145/3703187.3703294
Citations
1
Primary Topic
Human Pose and Action Recognition
Type
article
Field-Weighted Citation Impact
0.25
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Human skeleton action recognition based on feature-enhanced spatiotemporal graph convolutional network

Xia Liu, Jiashuang Zhu, Yazhuo Li, Chenran Luo et al.
1 citations
Human Pose and Action Recognition
0.25
article

Human skeleton action recognition based on feature-enhanced spatiotemporal graph convolutional network

Xia Liu, Jiashuang Zhu, Yazhuo Li, Chenran Luo, Xiangdong Zhou, Zixin Yan
article en
1 citations

Abstract

In recent years, deep learning-based human skeleton action recognition technology has seen significant development and application in areas such as human-computer interaction, security monitoring, and rehabilitation medicine. To address the issue of insufficient exploitation of spatiotemporal features in skeleton action recognition, this paper designs a Spatiotemporal Graph Convolutional Network with feature enhancement. This network enhances features from the perspectives of nodes, space, and time to improve the accuracy of skeleton action recognition. Firstly, by connecting graphs of adjacent frames to construct local spatiotemporal graphs, the network achieves a more comprehensive capture of spatial and temporal dependencies. Next, in the spatial graph convolution operations, self-attention mechanisms and channel attention modules are used to learn separate topological structures for different time frames, allowing the model to capture complex changes in human body structure across various time frames. Finally, in the temporal convolution stage, the use of multi-scale convolutional kernels enhances the perception of features across different temporal domains. This human skeleton action recognition model demonstrates efficient spatiotemporal feature extraction capabilities and excellent performance.

Jianghan University (CN)
Openalex Percentile: Top 43%
Human Pose and Action Recognition
0.25
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.