Decoding Musical Valence and Arousal: Exploring the Neural Correlates of Music-Evoked Emotions and the Role of Expressivity Features
Music conveys both basic emotions, like joy and sadness, and complex ones, such as tenderness and nostalgia. Its effects on emotion regulation and reward have attracted much research attention, as the neural correlates of music-evoked emotions may inform neurorehabilitation interventions. Here, we used fMRI to decode and examine the neural correlates of perceived valence and arousal in music excerpts. Twenty participants were scanned while listening to 96 music excerpts, classified beforehand into four categories varying in valence and arousal. Music modulated activity in cortical regions, most noticeably in music-specific subregions of the auditory cortex, thalamus, and regions of the reward network such as the amygdala. Using multivoxel pattern analysis, we created a computational model to decode the perceived valence and arousal of the music excerpts with above-chance accuracy. We further explored associations between musical features and brain activity in valence-, arousal-, reward-, and auditory-related networks. The results emphasize the involvement of distinct musical features, notably expressive features such as vibrato and tonal and spectral dissonance in valence, arousal, and reward brain networks. Using ecologically valid music stimuli, we contribute to delineating the neural correlates of music-evoked emotions with potential implications in the development of novel music-based neurorehabilitation strategies.
Authors
- Inês Bernardino (ORCID: https://orcid.org/0000-0003-3123-008X)
- Teresa Sousa (ORCID: https://orcid.org/0000-0003-2652-3152)
- Daniela Pereira (ORCID: https://orcid.org/0000-0002-9700-810X)
- Rui Pedro Paiva (ORCID: https://orcid.org/0000-0003-3215-3960)
- César F. Lima (ORCID: https://orcid.org/0000-0003-3058-7204)
- Renato Panda (ORCID: https://orcid.org/0000-0003-2539-5590)
- Bruno Direito (ORCID: https://orcid.org/0000-0002-3259-8815)
- Inês Almeida (ORCID: https://orcid.org/0000-0003-0230-3075)
- Alexandre Sayal (ORCID: https://orcid.org/0000-0002-0476-9533)
- Miguel Castelo‐Branco (ORCID: https://orcid.org/0000-0003-4364-6373)
- Ana Gabriela Guedes (ORCID: https://orcid.org/0009-0000-0010-9389)
Institutions
- Iscte – Instituto Universitário de Lisboa (PT)
- Iscte – Instituto Universitário de Lisboa (PT)
- Siemens (Portugal) (PT)
- Institute for Systems Engineering and Computers (PT)
- Instituto Politécnico de Tomar (PT)
- Research Center for Natural Resources, Environment and Society (PT)
- University of Coimbra (PT)
Publication Details
- Journal
- IEEE Transactions on Affective Computing
- Published
- 2024-11-27
- DOI
- https://doi.org/10.1109/taffc.2024.3507192
- Citations
- 5
- Primary Topic
- Neuroscience and Music Perception
- Type
- article
- Field-Weighted Citation Impact
- 1.71