Improving Voice-Based Emotion Recognition Using Convolutional Neural Networks: Integrating RAVDESS and JL Corpus Datasets

Voice-based emotion recognition has garnered significant attention in data science, with applications in fields such as psychology, gaming, healthcare, and customer service. This study explores emotion detection using voice recordings from the JL Corpus and RAVDESS datasets, employing Convolutional Neural Networks (CNNs) to classify emotions such as neutral, calm, happy, sad, angry, fearful, disgusted, and surprised. Mel Frequency Cepstral Coefficients (MFCCs) are used for feature extraction. The CNN model achieved 73% accuracy on the RAVDESS dataset, though it underperformed compared to previous studies using multimodal data. However, combining the JL Corpus with RAVDESS improved accuracy to $85 \%$ and significantly enhanced precision and recall. Misclassifications between similar emotions highlight the limitations of amplitude-based features, suggesting the need for more advanced feature extraction techniques. This research contributes to the growing body of work in emotion recognition, emphasizing the potential for dataset integration and feature refinement to improve model performance.

Authors

Institutions

Publication Details

Published
2024-11-22
DOI
https://doi.org/10.1109/iscmi63661.2024.10851641
Citations
2
Primary Topic
Speech Recognition and Synthesis
Type
article
Field-Weighted Citation Impact
0.69
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Improving Voice-Based Emotion Recognition Using Convolutional Neural Networks: Integrating RAVDESS and JL Corpus Datasets

Irving Vitra Paputungan, Arrie Kurniawardhani, Rio Galang Jati Respati
2 citations
Speech Recognition and Synthesis
0.69
article

Improving Voice-Based Emotion Recognition Using Convolutional Neural Networks: Integrating RAVDESS and JL Corpus Datasets

Irving Vitra Paputungan, Arrie Kurniawardhani, Rio Galang Jati Respati
article en
2 citations

Abstract

Voice-based emotion recognition has garnered significant attention in data science, with applications in fields such as psychology, gaming, healthcare, and customer service. This study explores emotion detection using voice recordings from the JL Corpus and RAVDESS datasets, employing Convolutional Neural Networks (CNNs) to classify emotions such as neutral, calm, happy, sad, angry, fearful, disgusted, and surprised. Mel Frequency Cepstral Coefficients (MFCCs) are used for feature extraction. The CNN model achieved 73% accuracy on the RAVDESS dataset, though it underperformed compared to previous studies using multimodal data. However, combining the JL Corpus with RAVDESS improved accuracy to $85 \%$ and significantly enhanced precision and recall. Misclassifications between similar emotions highlight the limitations of amplitude-based features, suggesting the need for more advanced feature extraction techniques. This research contributes to the growing body of work in emotion recognition, emphasizing the potential for dataset integration and feature refinement to improve model performance.

Islamic University of Indonesia (ID)
Openalex Percentile: Top 22%
Speech Recognition and Synthesis
0.69
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.