MVST: A Multi-view Spatio-temporal Transformer for Skill-aware Tennis Stroke Recognition from Skeleton Sequences
This paper proposes a Multi-View Spatio-Temporal Transformer (MVST) for skill-aware tennis stroke recognition from paired skeleton sequences.Estimating a player's skill level from movement patterns, beyond recognizing the performed action itself, remains a challenging problem in computer vision.A shared transformer encoder models spatial landmark relationships and temporal motion dynamics, while back-view and side-view representations are fused to reduce viewpoint ambiguity.A Cross-View Alignment (CVA) objective is introduced as an auxiliary contrastive loss that aligns view-level embeddings of the same stroke instance during training, with no inference overhead.On a self-collected dataset of eight subjects and 96 paired stroke instances, evaluated under a reproducible five-seed, four-fold subject-independent protocol, MVST with CVA achieves a final-epoch accuracy of 0.83, showing higher mean accuracy than ST-GCN, SkateFormer and SA-TDGFormer while achieving comparable performance to CTR-GCN with 2.4 times fewer parameters and 1.4 times fewer FLOPs.A leave-one-subject-out analysis achieves 0.85 skill-classification accuracy on subjects excluded from training, indicating that the learned representation can generalize to unseen subjects within this cohort.
Authors
- Ibnu Asror (ORCID: https://orcid.org/0000-0002-0142-7095)
- Bayu Erfianto (ORCID: https://orcid.org/0000-0001-5677-2235)
- Achmad Rizal
- Maman Abdurohman (ORCID: https://orcid.org/0000-0002-7321-3440)
Institutions
- Telkom University (ID)
Publication Details
- Journal
- International journal of intelligent engineering and systems
- Published
- 2026-11-17
- DOI
- https://doi.org/10.22266/ijies2026.1231.46
- Primary Topic
- Human Pose and Action Recognition
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Universitas Telkom