Multi-Stream GCN and CNN for Skeleton-Based Action Recognition

This paper presents two novel approaches for improving skeleton-based action recognition using Graph Convolutional Networks (GCN) and Convolutional Neural Networks (CNN). In the first approach, we combine GCN and CNN streams that process position and velocity features to improve classification accuracy. In the second approach, we use GCN as an embedding layer for support network CNN to extract features from skeleton data, which significantly improves recognition accuracy. Our experiments on the JHMDB dataset demonstrate that our approaches outperform state-of-the-art methods while using significantly fewer parameters. Additionally, we extended our evaluation to the Kinetics-400 dataset, where our methods showed comparable results with considerably lower model complexity. Our work contributes to the development of more efficient and robust action recognition models.

Authors

Institutions

Publication Details

Published
2024-10-06
DOI
https://doi.org/10.1109/smc54092.2024.10831761
Primary Topic
Human Pose and Action Recognition
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Multi-Stream GCN and CNN for Skeleton-Based Action Recognition

Nguyen Anh Tu, Tomiris Zhaksylyk, Kenzhebek Taniyev
Human Pose and Action Recognition
article

Multi-Stream GCN and CNN for Skeleton-Based Action Recognition

Nguyen Anh Tu, Tomiris Zhaksylyk, Kenzhebek Taniyev
article en

Abstract

This paper presents two novel approaches for improving skeleton-based action recognition using Graph Convolutional Networks (GCN) and Convolutional Neural Networks (CNN). In the first approach, we combine GCN and CNN streams that process position and velocity features to improve classification accuracy. In the second approach, we use GCN as an embedding layer for support network CNN to extract features from skeleton data, which significantly improves recognition accuracy. Our experiments on the JHMDB dataset demonstrate that our approaches outperform state-of-the-art methods while using significantly fewer parameters. Additionally, we extended our evaluation to the Kinetics-400 dataset, where our methods showed comparable results with considerably lower model complexity. Our work contributes to the development of more efficient and robust action recognition models.

Nazarbayev University (KZ)
Nazarbayev University
Openalex Percentile: Top 74%
Human Pose and Action Recognition
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.