Mathematical Analysis and Performance Evaluation of CBAM-DenseNet121 for Speech Emotion Recognition Using the CREMA-D Dataset
Emotion recognition from speech is essential for human–computer interaction (HCI) and affective computing, with applications in virtual assistants, healthcare, and education. Although deep learning has made significant advancements in Automatic Speech Emotion Recognition (ASER), the challenge still exists in the task given variation in speakers, subtle emotional expressions, and environmental noise. Practical deployment in this context depends on a strong, fast, scalable recognition system. This work introduces a new framework combining DenseNet121, especially fine-tuned for the crowd-sourced emotional multimodal actors dataset (CREMA-D), with the convolutional block attention module (CBAM). While DenseNet121’s effective feature propagation captures rich, hierarchical patterns in the speech data, CBAM improves the focus of the model on emotionally significant elements by applying both spatial and channel-wise attention. Furthermore, enhancing the input spectrograms and strengthening resistance against environmental noise is an advanced preprocessing pipeline including log-Mel spectrogram transformation and normalization. The proposed model demonstrates superior performance. To make sure the evaluation is strong even if there is a class imbalance, we point out important metrics like an Unweighted Average Recall (UAR) of 71.01% and an F1 score of 71.25%. The model also gets a test accuracy of 71.26% and a precision of 71.30%. These results establish the model as a promising solution for real-world speech emotion detection, highlighting its strong generalization capabilities, computational efficiency, and focus on emotion-specific features compared to recent work. The improvements demonstrate practical flexibility, enabling the integration of established image recognition techniques and allowing for substantial adaptability in various application contexts.
Authors
- Djamel Eddine Boukhari (ORCID: https://orcid.org/0000-0001-7209-7516)
- Nadjiba Terki (ORCID: https://orcid.org/0000-0003-0402-2322)
- Khaled Aldwoah (ORCID: https://orcid.org/0000-0001-5731-3532)
- Osman Osman (ORCID: https://orcid.org/0000-0001-5085-4002)
- Zineddine Sarhani Kahhoul
- Ilyes Benaissa
- E. I. Hassan
Institutions
- Qassim University (SA)
- University of Biskra (DZ)
- Imam Mohammad ibn Saud Islamic University (SA)
- CRSTRA (DZ)
- Islamic University of Madinah (SA)
Publication Details
- Journal
- Applied Sciences
- Published
- 2025-09-03
- DOI
- https://doi.org/10.3390/app15179692
- Primary Topic
- Emotion and Mood Recognition
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Qassim University