Classifying Music-Induced Emotion Using Multi-Modal Ensembles of EEG and Audio Feature Models

In this paper, we present our submission to the EEG-Music Emotion Recognition Challenge at ICASSP 2025. Our work focused on Task 2, where the objective was to classify the emotional state of subjects in a discrete valence-arousal space while they listen to music. Our proposed solution adopts an ensemble approach, integrating electroencephalography (EEG) signals, raw audio signals, and song features. We incorporated a diverse set of models, including Audio Spectrogram Transformer (AST) [1] and a dedicated EEG model. By combining insights from these modalities, we aimed to capture the interplay between music and emotional responses. We achieved a balanced accuracy of 41.34% on held-out data, improving the baseline by more than 11% and thus 2<sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">nd</sup> place in the competition.

Authors

Institutions

Publication Details

Published
2025-03-12
DOI
https://doi.org/10.1109/icassp49660.2025.10888818
Citations
3
Primary Topic
Music and Audio Processing
Type
article
Field-Weighted Citation Impact
4.46
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Classifying Music-Induced Emotion Using Multi-Modal Ensembles of EEG and Audio Feature Models

Luca Sacchetto, Philipp Paukner, Klaus Diepold, Deema Kamal Sabir et al.
3 citations
Music and Audio Processing
4.46
article

Classifying Music-Induced Emotion Using Multi-Modal Ensembles of EEG and Audio Feature Models

Luca Sacchetto, Philipp Paukner, Klaus Diepold, Deema Kamal Sabir, Marisa Ripoll
article en
3 citations

Abstract

In this paper, we present our submission to the EEG-Music Emotion Recognition Challenge at ICASSP 2025. Our work focused on Task 2, where the objective was to classify the emotional state of subjects in a discrete valence-arousal space while they listen to music. Our proposed solution adopts an ensemble approach, integrating electroencephalography (EEG) signals, raw audio signals, and song features. We incorporated a diverse set of models, including Audio Spectrogram Transformer (AST) [1] and a dedicated EEG model. By combining insights from these modalities, we aimed to capture the interplay between music and emotional responses. We achieved a balanced accuracy of 41.34% on held-out data, improving the baseline by more than 11% and thus 2<sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">nd</sup> place in the competition.

Technical University of Munich (DE)
Reduced inequalities
Openalex Percentile: Top 7%
Music and Audio Processing
4.46
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.