Development of Interactive Artificial Intelligence Tools for Personalized Somatosensory and Rhythm Evaluation in Intelligent Music Education Platforms

Traditional music education often lacks interactivity and real-time adaptability, especially in remote settings. This study introduces a personalized somatosensory framework, TRPO-ResLSTM, for music education platforms. The system captures movement, rhythm, and response time, preprocesses data with Wiener filtering and Z-score normalization, and extracts features via FFT. Gesture recognition is performed by DeepRes-LSTM, while adaptive difficulty is regulated by TRPO reinforcement learning. Incremental learning ensures personalization across sessions. Experiments on a publicly available, anonymized gesture-rhythm dataset (n = 2,730 samples; training/validation/test split 70/15/15) show superior performance over multimodal baselines, achieving 95% accuracy, 93.5% precision, 94.6% recall, and 94.2% F1-score. Ablation studies confirm the individual contributions of TRPO and Res-LSTM. The innovation of this protocol lies in integrating reinforcement learning with residual temporal modeling for adaptive gesture recognition, enabling stable yet personalized learning. This work demonstrates that adaptive, gesture-responsive tools can enhance engagement, personalization, and progressive skill development in intelligent music education. Limitations include reliance on a single dataset and the need for real-learner validation, which define directions for future work.

Authors

Institutions

Publication Details

Journal
Journal of Visualized Experiments
Published
2025-12-19
DOI
https://doi.org/10.3791/69058
Primary Topic
Music Technology and Sound Studies
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Development of Interactive Artificial Intelligence Tools for Personalized Somatosensory and Rhythm Evaluation in Intelligent Music Education Platforms

L. Yan, Min Wang
Journal of Visualized Experiments
Music Technology and Sound Studies
article

Development of Interactive Artificial Intelligence Tools for Personalized Somatosensory and Rhythm Evaluation in Intelligent Music Education Platforms

L. Yan, Min Wang
article en

Abstract

Traditional music education often lacks interactivity and real-time adaptability, especially in remote settings. This study introduces a personalized somatosensory framework, TRPO-ResLSTM, for music education platforms. The system captures movement, rhythm, and response time, preprocesses data with Wiener filtering and Z-score normalization, and extracts features via FFT. Gesture recognition is performed by DeepRes-LSTM, while adaptive difficulty is regulated by TRPO reinforcement learning. Incremental learning ensures personalization across sessions. Experiments on a publicly available, anonymized gesture-rhythm dataset (n = 2,730 samples; training/validation/test split 70/15/15) show superior performance over multimodal baselines, achieving 95% accuracy, 93.5% precision, 94.6% recall, and 94.2% F1-score. Ablation studies confirm the individual contributions of TRPO and Res-LSTM. The innovation of this protocol lies in integrating reinforcement learning with residual temporal modeling for adaptive gesture recognition, enabling stable yet personalized learning. This work demonstrates that adaptive, gesture-responsive tools can enhance engagement, personalization, and progressive skill development in intelligent music education. Limitations include reliance on a single dataset and the need for real-learner validation, which define directions for future work.

Journal of Visualized Experiments(226)
Education and Early Childhood Development (CA)
Openalex Percentile: Top 57%
Music Technology and Sound Studies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Development of Interactive Artificial Intelligence Tools for Personalized Somatosensory and Rhythm Evaluation in Intelligent Music Education Platforms — L. Yan, Min Wang · Journal of Visualized Experiments (2025) | TGRS Research Map | TGRS