Emotion Classification in Music: Leveraging Machine Learning for Music Therapy and Emotional Response Analysis

Emotion classification in music is an evolving domain within affective computing that holds significant promise for applications in music therapy, personalized media experiences, and adaptive systems. This study proposes a comprehensive machine learning framework for multi-label emotion recognition in music, leveraging the publicly available Emotify dataset. The framework incorporates acoustic features, listener metadata (e.g., mood, age, gender), and genre classification to enhance predictive accuracy. We conducted six experimental modeling phases using Random Forest, Multi-Layer Perceptron (MLP), XGBoost, and their ensemble variants. The final model—a stacking ensemble combining the three base learners with a logistic regression meta-classifier—achieved superior results with a subset accuracy of 0.41, Hamming loss of 0.25, and macro-averaged F1 score of 0.67. Comparative analysis with recent studies indicates that our approach achieves higher macro-F1 performance than prior clip-level, multi-label methods evaluated on the Emotify dataset under comparable settings. These results highlight the critical role of ensemble strategies and multi-modal feature fusion in modeling complex emotional landscapes. The proposed model not only advances the state-of-the-art but also supports the development of emotionally adaptive systems and highlights promising potential for future music-therapy applications, subject to further usability and clinical-effectiveness evaluation.

Authors

Institutions

Publication Details

Journal
International Journal of Computational Intelligence Systems
Published
2026-04-26
DOI
https://doi.org/10.1007/s44196-026-01304-0
Primary Topic
Emotion and Mood Recognition
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Emotion Classification in Music: Leveraging Machine Learning for Music Therapy and Emotional Response Analysis

Jing Wu
International Journal of Computational Intelligence Systems
Emotion and Mood Recognition
article

Emotion Classification in Music: Leveraging Machine Learning for Music Therapy and Emotional Response Analysis

Jing Wu
article en

Abstract

Emotion classification in music is an evolving domain within affective computing that holds significant promise for applications in music therapy, personalized media experiences, and adaptive systems. This study proposes a comprehensive machine learning framework for multi-label emotion recognition in music, leveraging the publicly available Emotify dataset. The framework incorporates acoustic features, listener metadata (e.g., mood, age, gender), and genre classification to enhance predictive accuracy. We conducted six experimental modeling phases using Random Forest, Multi-Layer Perceptron (MLP), XGBoost, and their ensemble variants. The final model—a stacking ensemble combining the three base learners with a logistic regression meta-classifier—achieved superior results with a subset accuracy of 0.41, Hamming loss of 0.25, and macro-averaged F1 score of 0.67. Comparative analysis with recent studies indicates that our approach achieves higher macro-F1 performance than prior clip-level, multi-label methods evaluated on the Emotify dataset under comparable settings. These results highlight the critical role of ensemble strategies and multi-modal feature fusion in modeling complex emotional landscapes. The proposed model not only advances the state-of-the-art but also supports the development of emotionally adaptive systems and highlights promising potential for future music-therapy applications, subject to further usability and clinical-effectiveness evaluation.

International Journal of Computational Intelligence Systems
Hunan University of Traditional Chinese Medicine (CN)
Gender equality
Openalex Percentile: Top 4%
Emotion and Mood Recognition
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.