Performance Evaluation of Speech Emotion Recognition Using Hybrid Feature Selection and Machine Learning

Speech Emotion Recognition (SER) plays a crucial role in human-computer interaction, offering insights into user emotions, particularly in environments with complex acoustic interactions such as songs. Traditional machine learning classifiers struggle with these complexities, especially when distinguishing emotions in the presence of vocals and background music. This study proposes a hybrid feature selection strategy to enhance SER accuracy for six distinct emotions: neutral, calm, happy, sad, angry, and fearful. Using the RAVDESS database, consisting of 1,012 recordings, we extracted 33 time-frequency features, including energy, spectral descriptors, MFCCs, and chroma. A hybrid framework combining filter-based (chi-square) and embedded (random forest importance) methods was implemented. Four classifiers K Nearest Neighbors (K-NN), Support Vector Machine (SVM), Random Forest (RF), and Gradient Boosting (GB) were evaluated across three paradigms: filter-only, embedded-only, and hybrid. The hybrid feature selection method outperformed the others, with SVM achieving a peak accuracy of 83.55% (RBF kernel) and K-NN showing a 6.25% improvement over baseline performance (81.91%). These results demonstrate that hybrid feature selection enhances traditional machine learning classifiers, allowing them to achieve performance comparable to deep learning models while maintaining computational efficiency. This approach is particularly advantageous for deploying SER in resource-constrained environments, offering a balance between accuracy and efficiency in emotion recognition applications.

Authors

Institutions

Publication Details

Published
2025-08-15
DOI
https://doi.org/10.1109/iccit65724.2025.11166879
Citations
3
Primary Topic
Speech Recognition and Synthesis
Type
article
Field-Weighted Citation Impact
7.44
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Performance Evaluation of Speech Emotion Recognition Using Hybrid Feature Selection and Machine Learning

Puguh Hiskiawan, Ferdinand Mahardhika, Marta Lenah Haryanti
3 citations
Speech Recognition and Synthesis
7.44
article

Performance Evaluation of Speech Emotion Recognition Using Hybrid Feature Selection and Machine Learning

Puguh Hiskiawan, Ferdinand Mahardhika, Marta Lenah Haryanti
article en
3 citations

Abstract

Speech Emotion Recognition (SER) plays a crucial role in human-computer interaction, offering insights into user emotions, particularly in environments with complex acoustic interactions such as songs. Traditional machine learning classifiers struggle with these complexities, especially when distinguishing emotions in the presence of vocals and background music. This study proposes a hybrid feature selection strategy to enhance SER accuracy for six distinct emotions: neutral, calm, happy, sad, angry, and fearful. Using the RAVDESS database, consisting of 1,012 recordings, we extracted 33 time-frequency features, including energy, spectral descriptors, MFCCs, and chroma. A hybrid framework combining filter-based (chi-square) and embedded (random forest importance) methods was implemented. Four classifiers K Nearest Neighbors (K-NN), Support Vector Machine (SVM), Random Forest (RF), and Gradient Boosting (GB) were evaluated across three paradigms: filter-only, embedded-only, and hybrid. The hybrid feature selection method outperformed the others, with SVM achieving a peak accuracy of 83.55% (RBF kernel) and K-NN showing a 6.25% improvement over baseline performance (81.91%). These results demonstrate that hybrid feature selection enhances traditional machine learning classifiers, allowing them to achieve performance comparable to deep learning models while maintaining computational efficiency. This approach is particularly advantageous for deploying SER in resource-constrained environments, offering a balance between accuracy and efficiency in emotion recognition applications.

University of Bunda Mulia (ID)
Openalex Percentile: Top 3%
Speech Recognition and Synthesis
7.44
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.