MusicARLtrans Net: a multimodal agent interactive music education system driven via reinforcement learning
This approach provides a personalized and real-time feedback interactive learning experience by effectively combining auditory, visual, and textual information. The system collects and annotates multimodal data related to music education, trains and integrates various modules, and ultimately delivers an efficient and intelligent music education agent. Experimental results demonstrate that MusicARLtrans Net significantly outperforms traditional methods, achieving an accuracy of <b>96.77%</b> on the LibriSpeech dataset and <b>97.55%</b> on the MS COCO dataset, with marked improvements in recall, F1 score, and AUC metrics. These results highlight the system's superiority in speech recognition accuracy, multimodal data understanding, and teaching strategy optimization, which together lead to enhanced learning outcomes and user satisfaction. The findings hold substantial academic and practical significance, demonstrating the potential of advanced AI-driven systems in revolutionizing music education.
Authors
- Zhenmeng Wang
- Chao Yan (ORCID: https://orcid.org/0000-0002-2691-7955)
- Jie Chang (ORCID: https://orcid.org/0000-0002-3601-5402)
Institutions
- Qufu Normal University (CN)
Publication Details
- Journal
- Frontiers in Neurorobotics
- Published
- 2024-11-21
- DOI
- https://doi.org/10.3389/fnbot.2024.1479694
- Citations
- 6
- Primary Topic
- Music and Audio Processing
- Type
- article
- Field-Weighted Citation Impact
- 2.10