Speech Emotion Recognition Using ML Models and Audio Features

The ability to recognize and respond to human emotions has become a crucial component in enhancing humancomputer interaction, with the development of speech emotion recognition technologies playing a pivotal role in this advancement. While deep learning models have driven significant progress in the field of speech emotion recognition, traditional machine learning algorithms offer a practical alternative, balancing performance with lower computational requirements. This study presents a comprehensive approach to speech emotion recognition using the Berlin Emotional Speech Database, classifying seven emotional states: anger, sadness, anxiety or fear, disgust, boredom, happiness, and neutrality. The study employs a range of acoustic features, including pitch, RMS energy, MFCCs, and formants, which are combined with 14 statistical descriptors and extracted using tools like OpenSMILE. Preprocessing steps, such as normalization, noise reduction, and silence removal, are applied to enhance the quality and reliability of the data. The performance of traditional machine learning models, including Support Vector Machine, Random Forest, and <tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">$k$</tex>-Nearest Neighbors, is evaluated on the processed dataset. The results demonstrate the effectiveness of these traditional models, with Support Vector Machine achieving the highest classification accuracy of 90.65 %, followed by Random Forest and <tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">$k$</tex>-Nearest Neighbors. The results of this study highlight the capacity of traditional machine learning techniques to effectively capture the complexities of emotional expression, while circumventing the computational burden associated with deep learning models. The practical relevance of this research extends to real-time applications across various domains, including healthcare, virtual assistants, and customer service, where the demand for efficient and reliable emotion recognition systems is paramount.

Authors

Institutions

Publication Details

Published
2025-04-07
DOI
https://doi.org/10.1109/syscon64521.2025.11014858
Citations
2
Primary Topic
Speech and Audio Processing
Type
article
Field-Weighted Citation Impact
2.97
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Speech Emotion Recognition Using ML Models and Audio Features

Kasem Khalil, Ali Harimi, Ashok Kumar, T. James et al.
2 citations
Speech and Audio Processing
2.97
article

Speech Emotion Recognition Using ML Models and Audio Features

Kasem Khalil, Ali Harimi, Ashok Kumar, T. James, Rafeeq Muhammad, Tanner Mergist, T. Maheswara Reddy Yenumula
article en
2 citations

Abstract

The ability to recognize and respond to human emotions has become a crucial component in enhancing humancomputer interaction, with the development of speech emotion recognition technologies playing a pivotal role in this advancement. While deep learning models have driven significant progress in the field of speech emotion recognition, traditional machine learning algorithms offer a practical alternative, balancing performance with lower computational requirements. This study presents a comprehensive approach to speech emotion recognition using the Berlin Emotional Speech Database, classifying seven emotional states: anger, sadness, anxiety or fear, disgust, boredom, happiness, and neutrality. The study employs a range of acoustic features, including pitch, RMS energy, MFCCs, and formants, which are combined with 14 statistical descriptors and extracted using tools like OpenSMILE. Preprocessing steps, such as normalization, noise reduction, and silence removal, are applied to enhance the quality and reliability of the data. The performance of traditional machine learning models, including Support Vector Machine, Random Forest, and <tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">$k$</tex>-Nearest Neighbors, is evaluated on the processed dataset. The results demonstrate the effectiveness of these traditional models, with Support Vector Machine achieving the highest classification accuracy of 90.65 %, followed by Random Forest and <tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">$k$</tex>-Nearest Neighbors. The results of this study highlight the capacity of traditional machine learning techniques to effectively capture the complexities of emotional expression, while circumventing the computational burden associated with deep learning models. The practical relevance of this research extends to real-time applications across various domains, including healthcare, virtual assistants, and customer service, where the demand for efficient and reliable emotion recognition systems is paramount.

University of Mississippi (US), University of Louisiana at Lafayette (US)
Gender equality
Openalex Percentile: Top 9%
Speech and Audio Processing
2.97
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.