Development of Interactive Artificial Intelligence Tools for Personalized Somatosensory and Rhythm Evaluation in Intelligent Music Education Platforms
Traditional music education often lacks interactivity and real-time adaptability, especially in remote settings. This study introduces a personalized somatosensory framework, TRPO-ResLSTM, for music education platforms. The system captures movement, rhythm, and response time, preprocesses data with Wiener filtering and Z-score normalization, and extracts features via FFT. Gesture recognition is performed by DeepRes-LSTM, while adaptive difficulty is regulated by TRPO reinforcement learning. Incremental learning ensures personalization across sessions. Experiments on a publicly available, anonymized gesture-rhythm dataset (n = 2,730 samples; training/validation/test split 70/15/15) show superior performance over multimodal baselines, achieving 95% accuracy, 93.5% precision, 94.6% recall, and 94.2% F1-score. Ablation studies confirm the individual contributions of TRPO and Res-LSTM. The innovation of this protocol lies in integrating reinforcement learning with residual temporal modeling for adaptive gesture recognition, enabling stable yet personalized learning. This work demonstrates that adaptive, gesture-responsive tools can enhance engagement, personalization, and progressive skill development in intelligent music education. Limitations include reliance on a single dataset and the need for real-learner validation, which define directions for future work.
Authors
- L. Yan (ORCID: https://orcid.org/0009-0008-6584-5350)
- Min Wang (ORCID: https://orcid.org/0000-0001-7025-7651)
Institutions
- Education and Early Childhood Development (CA)
Publication Details
- Journal
- Journal of Visualized Experiments
- Published
- 2025-12-19
- DOI
- https://doi.org/10.3791/69058
- Primary Topic
- Music Technology and Sound Studies
- Type
- article
- Field-Weighted Citation Impact
- 0.00