Artificial Intelligence Feedback Based Investigation of Emotional Regulation Effects in Music Learning

With increasing use of artificial intelligence for performance evaluation in music education, repeated mistakes may cause frustration, anxiety, and even withdrawal from practice due to lack of proper feedback mechanisms addressing such problems. This study developed a multimodal feedback system based on MIDI performance, facial expression coefficients, and interaction logs where an attention-based BiLSTM predicted valence, arousal, and need for high regulation and then used contextual Thompson sampling to select affect-adaptive feedback. In the pilot study, the dataset consisted of 1,080 practice segments from 45 novice piano players, and the six-week experiment included 90 subjects allocated into affect-adaptive, fixed technical, and metric-only feedback conditions. The full multimodal model obtained the following scores: Macro-F1 = 0.873, AUC = 0.936, ECE = 0.029, and MEEL = 46.7 ms. At posttest, note accuracy for the adaptive condition amounted to 93.1%, while in two other conditions, it amounted to 89.4% and 87.5%. Also, restart latency for the adaptive condition reduced to 7.3 seconds. Moreover, multilevel mediation analysis revealed a significant indirect effect through emotional recovery, β = 0.16, 95% CI [0.07, 0.27]. This research shows that integrating affect recognition with feedback selection is a promising direction for improving computational responsiveness and emotional regulation in music learning. Proposed architecture maintains boundaries set by teacher-reviewed feedback and separates performance and outcome evaluations.

Authors

Institutions

Publication Details

Journal
Applied and Computational Engineering
Published
2026-11-17
DOI
https://doi.org/10.54254/2755-2721/2026.39095
Primary Topic
Intelligent Tutoring Systems and Adaptive Learning
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Artificial Intelligence Feedback Based Investigation of Emotional Regulation Effects in Music Learning

Binru Zou
2 links
Applied and Computational Engineering
Intelligent Tutoring Systems and Adaptive Learning
article

Artificial Intelligence Feedback Based Investigation of Emotional Regulation Effects in Music Learning

Binru Zou
article en

Abstract

With increasing use of artificial intelligence for performance evaluation in music education, repeated mistakes may cause frustration, anxiety, and even withdrawal from practice due to lack of proper feedback mechanisms addressing such problems. This study developed a multimodal feedback system based on MIDI performance, facial expression coefficients, and interaction logs where an attention-based BiLSTM predicted valence, arousal, and need for high regulation and then used contextual Thompson sampling to select affect-adaptive feedback. In the pilot study, the dataset consisted of 1,080 practice segments from 45 novice piano players, and the six-week experiment included 90 subjects allocated into affect-adaptive, fixed technical, and metric-only feedback conditions. The full multimodal model obtained the following scores: Macro-F1 = 0.873, AUC = 0.936, ECE = 0.029, and MEEL = 46.7 ms. At posttest, note accuracy for the adaptive condition amounted to 93.1%, while in two other conditions, it amounted to 89.4% and 87.5%. Also, restart latency for the adaptive condition reduced to 7.3 seconds. Moreover, multilevel mediation analysis revealed a significant indirect effect through emotional recovery, β = 0.16, 95% CI [0.07, 0.27]. This research shows that integrating affect recognition with feedback selection is a promising direction for improving computational responsiveness and emotional regulation in music learning. Proposed architecture maintains boundaries set by teacher-reviewed feedback and separates performance and outcome evaluations.

Applied and Computational EngineeringVol. 282(1)
Shanghai University (CN), Shanghai Conservatory of Music (CN)
Quality education
Intelligent Tutoring Systems and Adaptive Learning
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon