Recognizing dance movements with ConvNeXtV2-BiLSTM and temporal attention

Recognizing subtle and complex dance movements requires models that can capture detailed spatial cues in individual frames while also tracking long-range temporal dynamics across entire performances. We propose a hybrid deep learning framework that first uses a modern convolutional neural network, pre-trained on large-scale image data, to extract multi-scale spatial features from each video frame and then applies a bidirectional recurrent neural network with a temporal attention mechanism to emphasize the most informative motion segments when aggregating features over time. The model is trained and evaluated on a video dataset of traditional Balinese dance movements, where it achieves higher classification accuracy and greater robustness to viewpoint changes and partial occlusion than several existing deep learning and classical machine learning baselines. Ablation experiments show that both the strong spatial feature extractor and the temporal attention module contribute significantly to performance gains. The resulting framework is compact, data-efficient, and easily adaptable to other cultural dance archives and more general tasks involving spatiotemporal human action recognition.

Authors

Institutions

Publication Details

Journal
PeerJ Computer Science
Published
2026-04-21
DOI
https://doi.org/10.7717/peerj-cs.3691
Primary Topic
Human Motion and Animation
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Recognizing dance movements with ConvNeXtV2-BiLSTM and temporal attention

Shuguang Pei, Tianjing Zhang
PeerJ Computer Science
Human Motion and Animation
article

Recognizing dance movements with ConvNeXtV2-BiLSTM and temporal attention

Shuguang Pei, Tianjing Zhang
article en

Abstract

Recognizing subtle and complex dance movements requires models that can capture detailed spatial cues in individual frames while also tracking long-range temporal dynamics across entire performances. We propose a hybrid deep learning framework that first uses a modern convolutional neural network, pre-trained on large-scale image data, to extract multi-scale spatial features from each video frame and then applies a bidirectional recurrent neural network with a temporal attention mechanism to emphasize the most informative motion segments when aggregating features over time. The model is trained and evaluated on a video dataset of traditional Balinese dance movements, where it achieves higher classification accuracy and greater robustness to viewpoint changes and partial occlusion than several existing deep learning and classical machine learning baselines. Ablation experiments show that both the strong spatial feature extractor and the temporal attention module contribute significantly to performance gains. The resulting framework is compact, data-efficient, and easily adaptable to other cultural dance archives and more general tasks involving spatiotemporal human action recognition.

PeerJ Computer ScienceVol. 12
Yancheng Teachers University (CN)
Openalex Percentile: Top 16%
Human Motion and Animation
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.