Multimodal human action recognition and personalized sports health promotion: a deep learning framework integrating wearable sensor fusion

Introduction: In real-world sports scenarios, Human Action Recognition (HAR) is often hindered by data complexity, limited dynamic adaptability, and fragmented integration of physiological and kinematic information. To address these challenges, this study proposes a multimodal HAR framework for personalized sports health promotion by integrating wearable sensor streams with deep learning architectures. Methods: The proposed system employs a robust sensing layer to capture 12-dimensional multimodal data and synchronize physiological indicators with behavioral signals in real time. A novel Transformer-GCN hybrid model was developed to extract complex spatiotemporal dependencies for accurate action recognition and dynamic state analysis. In addition, a reinforcement learning module was incorporated to generate adaptive exercise prescriptions based on user progress. The framework was deployed through a responsive interface for real-time intervention and evaluated in a 12-week randomized controlled trial. Results: max), a 99.3% improvement in muscular endurance, and a sports injury rate maintained below 15%. These findings indicate that the framework can support accurate motion analysis and safe, personalized intervention. Discussion: The proposed multimodal fusion architecture effectively bridges the gap between action recognition and personalized sports health intervention. By combining wearable sensing, hybrid deep learning, and reinforcement learning, the framework provides a practical solution for AI-driven motion analysis and adaptive health promotion in land sports scenarios.

Authors

Institutions

Publication Details

Journal
Frontiers in Neurorobotics
Published
2026-04-10
DOI
https://doi.org/10.3389/fnbot.2026.1785114
Primary Topic
Human Pose and Action Recognition
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Multimodal human action recognition and personalized sports health promotion: a deep learning framework integrating wearable sensor fusion

Taibin Huang, Ying Xi, Zhiyu Yang
Frontiers in Neurorobotics
Human Pose and Action Recognition
article

Multimodal human action recognition and personalized sports health promotion: a deep learning framework integrating wearable sensor fusion

Taibin Huang, Ying Xi, Zhiyu Yang
article en

Abstract

Introduction: In real-world sports scenarios, Human Action Recognition (HAR) is often hindered by data complexity, limited dynamic adaptability, and fragmented integration of physiological and kinematic information. To address these challenges, this study proposes a multimodal HAR framework for personalized sports health promotion by integrating wearable sensor streams with deep learning architectures. Methods: The proposed system employs a robust sensing layer to capture 12-dimensional multimodal data and synchronize physiological indicators with behavioral signals in real time. A novel Transformer-GCN hybrid model was developed to extract complex spatiotemporal dependencies for accurate action recognition and dynamic state analysis. In addition, a reinforcement learning module was incorporated to generate adaptive exercise prescriptions based on user progress. The framework was deployed through a responsive interface for real-time intervention and evaluated in a 12-week randomized controlled trial. Results: max), a 99.3% improvement in muscular endurance, and a sports injury rate maintained below 15%. These findings indicate that the framework can support accurate motion analysis and safe, personalized intervention. Discussion: The proposed multimodal fusion architecture effectively bridges the gap between action recognition and personalized sports health intervention. By combining wearable sensing, hybrid deep learning, and reinforcement learning, the framework provides a practical solution for AI-driven motion analysis and adaptive health promotion in land sports scenarios.

Frontiers in NeuroroboticsVol. 20
Xinyu University (CN)
Openalex Percentile: Top 28%
Human Pose and Action Recognition
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.