MVST: A Multi-view Spatio-temporal Transformer for Skill-aware Tennis Stroke Recognition from Skeleton Sequences

This paper proposes a Multi-View Spatio-Temporal Transformer (MVST) for skill-aware tennis stroke recognition from paired skeleton sequences.Estimating a player's skill level from movement patterns, beyond recognizing the performed action itself, remains a challenging problem in computer vision.A shared transformer encoder models spatial landmark relationships and temporal motion dynamics, while back-view and side-view representations are fused to reduce viewpoint ambiguity.A Cross-View Alignment (CVA) objective is introduced as an auxiliary contrastive loss that aligns view-level embeddings of the same stroke instance during training, with no inference overhead.On a self-collected dataset of eight subjects and 96 paired stroke instances, evaluated under a reproducible five-seed, four-fold subject-independent protocol, MVST with CVA achieves a final-epoch accuracy of 0.83, showing higher mean accuracy than ST-GCN, SkateFormer and SA-TDGFormer while achieving comparable performance to CTR-GCN with 2.4 times fewer parameters and 1.4 times fewer FLOPs.A leave-one-subject-out analysis achieves 0.85 skill-classification accuracy on subjects excluded from training, indicating that the learned representation can generalize to unseen subjects within this cohort.

Authors

Institutions

Publication Details

Journal
International journal of intelligent engineering and systems
Published
2026-11-17
DOI
https://doi.org/10.22266/ijies2026.1231.46
Primary Topic
Human Pose and Action Recognition
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

MVST: A Multi-view Spatio-temporal Transformer for Skill-aware Tennis Stroke Recognition from Skeleton Sequences

Ibnu Asror, Bayu Erfianto, Achmad Rizal, Maman Abdurohman
1 links
International journal of intelligent engineering and systems
Human Pose and Action Recognition
article

MVST: A Multi-view Spatio-temporal Transformer for Skill-aware Tennis Stroke Recognition from Skeleton Sequences

Ibnu Asror, Bayu Erfianto, Achmad Rizal, Maman Abdurohman
article en

Abstract

This paper proposes a Multi-View Spatio-Temporal Transformer (MVST) for skill-aware tennis stroke recognition from paired skeleton sequences.Estimating a player's skill level from movement patterns, beyond recognizing the performed action itself, remains a challenging problem in computer vision.A shared transformer encoder models spatial landmark relationships and temporal motion dynamics, while back-view and side-view representations are fused to reduce viewpoint ambiguity.A Cross-View Alignment (CVA) objective is introduced as an auxiliary contrastive loss that aligns view-level embeddings of the same stroke instance during training, with no inference overhead.On a self-collected dataset of eight subjects and 96 paired stroke instances, evaluated under a reproducible five-seed, four-fold subject-independent protocol, MVST with CVA achieves a final-epoch accuracy of 0.83, showing higher mean accuracy than ST-GCN, SkateFormer and SA-TDGFormer while achieving comparable performance to CTR-GCN with 2.4 times fewer parameters and 1.4 times fewer FLOPs.A leave-one-subject-out analysis achieves 0.85 skill-classification accuracy on subjects excluded from training, indicating that the learned representation can generalize to unseen subjects within this cohort.

International journal of intelligent engineering and systemsVol. 19(12)
Telkom University (ID)
Universitas Telkom
Human Pose and Action Recognition
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon