Discriminative Skeleton-Based Action Recognition via Semantic Enhancement and Key Frame Selection

Skeleton-based action recognition supports applications such as human–computer interaction and rehabilitation monitoring, motivating the development of accurate models with compact parameterizations. Although Transformers capture long-range spatiotemporal dependencies, their representations may contain redundant joint and channel responses, uninformative frames, and insufficiently constrained latent statistics. We propose SKD-Net, a lightweight framework that combines semantic and temporal refinement with latent regularization. The Semantic Enhancement Module (SEM) constructs a channel descriptor from a sample-adaptive subset of joints to guide global–local channel recalibration while preserving the complete joint representation. The Key Frame Selection Module (KFSM) combines independently normalized feature-space motion variation and skeletal directional variation to rank and retain frames without an additional learnable temporal scoring network. These designs are complemented by the Discriminative Representation Constraint Module (DRCM), which adopts established first-order Maximum Mean Discrepancy regularization to align global and class-conditional latent means with reference means under classification supervision. Experiments on NTU RGB+D 60, NTU RGB+D 120, and NW-UCLA demonstrate competitive recognition performance with 1.98 million parameters. Repeated-run evaluations show modest average improvements over the reproduced baseline on the two NTU Cross-Subject protocols, while controlled ablations examine the contributions of temporal selection and latent regularization. The results support SKD-Net as a compact recognition framework for researchers and developers interested in skeleton-based action recognition with a limited model parameter budget.

Authors

Institutions

Publication Details

Journal
Applied Sciences
Published
2026-11-18
DOI
https://doi.org/10.3390/app162211440
Primary Topic
Human Pose and Action Recognition
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Discriminative Skeleton-Based Action Recognition via Semantic Enhancement and Key Frame Selection

Zhixiang Zou, Ming Wu, Hao Guo, Chunhui Tang
2 links
Applied Sciences
Human Pose and Action Recognition
article

Discriminative Skeleton-Based Action Recognition via Semantic Enhancement and Key Frame Selection

Zhixiang Zou, Ming Wu, Hao Guo, Chunhui Tang
article en

Abstract

Skeleton-based action recognition supports applications such as human–computer interaction and rehabilitation monitoring, motivating the development of accurate models with compact parameterizations. Although Transformers capture long-range spatiotemporal dependencies, their representations may contain redundant joint and channel responses, uninformative frames, and insufficiently constrained latent statistics. We propose SKD-Net, a lightweight framework that combines semantic and temporal refinement with latent regularization. The Semantic Enhancement Module (SEM) constructs a channel descriptor from a sample-adaptive subset of joints to guide global–local channel recalibration while preserving the complete joint representation. The Key Frame Selection Module (KFSM) combines independently normalized feature-space motion variation and skeletal directional variation to rank and retain frames without an additional learnable temporal scoring network. These designs are complemented by the Discriminative Representation Constraint Module (DRCM), which adopts established first-order Maximum Mean Discrepancy regularization to align global and class-conditional latent means with reference means under classification supervision. Experiments on NTU RGB+D 60, NTU RGB+D 120, and NW-UCLA demonstrate competitive recognition performance with 1.98 million parameters. Repeated-run evaluations show modest average improvements over the reproduced baseline on the two NTU Cross-Subject protocols, while controlled ablations examine the contributions of temporal selection and latent regularization. The results support SKD-Net as a compact recognition framework for researchers and developers interested in skeleton-based action recognition with a limited model parameter budget.

Applied SciencesVol. 16(22)
University of Shanghai for Science and Technology (CN), VIB-KU Leuven Center for Microbiology (BE), Guangdong Polytechnic Normal University (CN), KU Leuven (BE)
Human Pose and Action Recognition
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon