Feature centric based deep learning approach for music mood recognition with HuBERT transformer model

In this study, music mood classification is explored using advanced deep learning and transformer-based models to accurately predict the emotional content of music. Music plays a crucial role in human life, influencing emotions, behaviors, and mental states. Accurately classifying the mood of music is essential for applications such as music recommendation systems, emotional intelligence in AI, and mental health monitoring. With the growing impact of Artificial Intelligence (AI) in emotion recognition, sentiment analysis has become a vital research area, contributing to fields like social media monitoring, customer experience analysis, and personalized content delivery. We employ a state-of-the-art transformer-based model (HuBERT) in comparison with deep learning models (ConvFormer, LSTM) and pre-trained models (YAMNet) to evaluate their effectiveness in music mood classification. The study is conducted on a publicly available dataset containing five mood labels such as Aggressive, Happy, Dramatic, Sad, and Romantic with 500 audio files per category. To analyze and extract meaningful patterns from the dataset, advanced different five audio features such as Short-Time Fourier Transform (STFT), and Mel-Frequency Cepstral Coefficients (MFCC) are utilized. To ensure robust model evaluation, an 80-20 holdout split is applied. Our experimental results indicate that HuBERT achieves the highest classification accuracy of 95%, outperforming both traditional deep learning models and pre-trained architecture. This study provides a comprehensive evaluation of machine learning approaches for music mood classification, demonstrating the potential of transformer-based models in enhancing AI-driven sentiment analysis. The findings contribute to the development of intelligent music recommendation systems, emotional AI applications, and advancements in affective computing.

Authors

Institutions

Publication Details

Journal
Scientific Reports
Published
2025-11-27
DOI
https://doi.org/10.1038/s41598-025-29200-1
Primary Topic
Music and Audio Processing
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Feature centric based deep learning approach for music mood recognition with HuBERT transformer model

Yu Sun
Scientific Reports
Music and Audio Processing
article

Feature centric based deep learning approach for music mood recognition with HuBERT transformer model

Yu Sun
article en

Abstract

In this study, music mood classification is explored using advanced deep learning and transformer-based models to accurately predict the emotional content of music. Music plays a crucial role in human life, influencing emotions, behaviors, and mental states. Accurately classifying the mood of music is essential for applications such as music recommendation systems, emotional intelligence in AI, and mental health monitoring. With the growing impact of Artificial Intelligence (AI) in emotion recognition, sentiment analysis has become a vital research area, contributing to fields like social media monitoring, customer experience analysis, and personalized content delivery. We employ a state-of-the-art transformer-based model (HuBERT) in comparison with deep learning models (ConvFormer, LSTM) and pre-trained models (YAMNet) to evaluate their effectiveness in music mood classification. The study is conducted on a publicly available dataset containing five mood labels such as Aggressive, Happy, Dramatic, Sad, and Romantic with 500 audio files per category. To analyze and extract meaningful patterns from the dataset, advanced different five audio features such as Short-Time Fourier Transform (STFT), and Mel-Frequency Cepstral Coefficients (MFCC) are utilized. To ensure robust model evaluation, an 80-20 holdout split is applied. Our experimental results indicate that HuBERT achieves the highest classification accuracy of 95%, outperforming both traditional deep learning models and pre-trained architecture. This study provides a comprehensive evaluation of machine learning approaches for music mood classification, demonstrating the potential of transformer-based models in enhancing AI-driven sentiment analysis. The findings contribute to the development of intelligent music recommendation systems, emotional AI applications, and advancements in affective computing.

Scientific ReportsVol. 15(1)
Sangmyung University (KR)
Openalex Percentile: Top 55%
Music and Audio Processing
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.