An explainable real time sensor graph transformer for dance recognition

The automatic interpretation of dance motion sequences from inertial and pressure-based sensors requires models that maintain strict temporal fidelity, preserve orientation invariance, and produce verifiable reasoning suitable for real-time deployment on constrained hardware. Existing approaches frequently lose accuracy when confronted with heterogeneous choreography, variable sensor placement, or shifting performer-specific kinematics, and they offer limited access to the decision-relevant evidence that underlies their classifications. This study introduces an explainable sensor-driven dance recognition framework constructed around an Adaptive Sensor Normalisation module that performs quaternion-based orientation correction with drift-aware Kalman refinement, a Multi-Scale Motion Feature Extractor that applies tempo-conditioned dilation schedules to capture micro-step transitions and phrase-level rhythmic structures, and a Spatio-Temporal Graph Attention Core that integrates edge-weighted graph convolutions with dual spatial-temporal attention to quantify sensor saliency and temporal concentration. A final Explainable Decision and Feedback Layer links prototype-anchored latent representations with gradient-resolved saliency vectors to expose class-specific motion determinants. The system is optimized for edge-class execution through kernel-level compression and causal attention windows operating on a 512-sample sliding segment. Experiments on three inertial datasets indicate classification accuracy up to 94.2 percent, movement-quality estimation of 92.8 percent, and sub-8.5 millisecond per-frame latency that confirms stability under tempo variation, sensor drift, and partial channel loss.

Authors

Institutions

Publication Details

Journal
Scientific Reports
Published
2026-01-14
DOI
https://doi.org/10.1038/s41598-025-34691-z
Primary Topic
Human Motion and Animation
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

An explainable real time sensor graph transformer for dance recognition

Shan Wang, Jiayin Gao, Jinying Han
Scientific Reports
Human Motion and Animation
article

An explainable real time sensor graph transformer for dance recognition

Shan Wang, Jiayin Gao, Jinying Han
article en

Abstract

The automatic interpretation of dance motion sequences from inertial and pressure-based sensors requires models that maintain strict temporal fidelity, preserve orientation invariance, and produce verifiable reasoning suitable for real-time deployment on constrained hardware. Existing approaches frequently lose accuracy when confronted with heterogeneous choreography, variable sensor placement, or shifting performer-specific kinematics, and they offer limited access to the decision-relevant evidence that underlies their classifications. This study introduces an explainable sensor-driven dance recognition framework constructed around an Adaptive Sensor Normalisation module that performs quaternion-based orientation correction with drift-aware Kalman refinement, a Multi-Scale Motion Feature Extractor that applies tempo-conditioned dilation schedules to capture micro-step transitions and phrase-level rhythmic structures, and a Spatio-Temporal Graph Attention Core that integrates edge-weighted graph convolutions with dual spatial-temporal attention to quantify sensor saliency and temporal concentration. A final Explainable Decision and Feedback Layer links prototype-anchored latent representations with gradient-resolved saliency vectors to expose class-specific motion determinants. The system is optimized for edge-class execution through kernel-level compression and causal attention windows operating on a 512-sample sliding segment. Experiments on three inertial datasets indicate classification accuracy up to 94.2 percent, movement-quality estimation of 92.8 percent, and sub-8.5 millisecond per-frame latency that confirms stability under tempo variation, sensor drift, and partial channel loss.

Scientific ReportsVol. 16(1)
Northeast Normal University (CN), Guangzhou University (CN), Anyang University (KR)
Peace, Justice and strong institutions
Openalex Percentile: Top 88%
Human Motion and Animation
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.