Spatial-Temporal Interleaved Attention Graph Convolutional Networks for Skeleton-Based Hand Action Recognition

In recent years, skeleton-based hand movement recognition has garnered significant attention with the advancement of graph convolutional networks. While previous approaches have concentrated on modeling joint dependencies and enhancing representation through various attention mechanisms, they often fall short in capturing information over long distances and extended time periods. To address this limitation, we introduce the STIA-GCN model. This model employs three parallel graph convolution blocks to extract diverse action patterns, followed by multi-scale temporal convolution to enrich feature representation. Additionally, spatial-temporal interleaved attention mechanism is incorporated to effectively capture long-range dependencies across different temporal frames and spatial locations, thereby facilitating a deeper understanding of complex action patterns. Evaluations on benchmark datasets SHREC'17 Track and DHG-14/28 reveal that the proposed method outperforms existing approaches in dynamic gesture recognition tasks.

Authors

Institutions

Publication Details

Published
2024-09-20
DOI
https://doi.org/10.1109/itnec60942.2024.10733051
Citations
1
Primary Topic
Human Pose and Action Recognition
Type
article
Field-Weighted Citation Impact
0.25
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Spatial-Temporal Interleaved Attention Graph Convolutional Networks for Skeleton-Based Hand Action Recognition

Xingyu Chen, Ying Cui, Xiaowei Han
1 citations
Human Pose and Action Recognition
0.25
article

Spatial-Temporal Interleaved Attention Graph Convolutional Networks for Skeleton-Based Hand Action Recognition

Xingyu Chen, Ying Cui, Xiaowei Han
article en
1 citations

Abstract

In recent years, skeleton-based hand movement recognition has garnered significant attention with the advancement of graph convolutional networks. While previous approaches have concentrated on modeling joint dependencies and enhancing representation through various attention mechanisms, they often fall short in capturing information over long distances and extended time periods. To address this limitation, we introduce the STIA-GCN model. This model employs three parallel graph convolution blocks to extract diverse action patterns, followed by multi-scale temporal convolution to enrich feature representation. Additionally, spatial-temporal interleaved attention mechanism is incorporated to effectively capture long-range dependencies across different temporal frames and spatial locations, thereby facilitating a deeper understanding of complex action patterns. Evaluations on benchmark datasets SHREC'17 Track and DHG-14/28 reveal that the proposed method outperforms existing approaches in dynamic gesture recognition tasks.

Harbin University of Commerce (CN)
Openalex Percentile: Top 45%
Human Pose and Action Recognition
0.25
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.