Mitigating Corpus Bias in Speech Emotion Recognition: A Robust Hybrid Framework using Generalization-Aware Metaheuristic Feature Selection

A formidable challenge impeding the real-world deployment of Speech Emotion Recognition (SER) systems is the problem of corpus bias. Models trained on a specific speech dataset often experience a significant degradation in performance when tested on new, unseen data, which may differ in language, speaker demographics, recording conditions, and emotional expression styles. This lack of generalization severely limits the practical applicability of SER technology. This paper proposes a novel hybrid framework specifically designed to enhance cross-corpus robustness by integrating deep learning for feature extraction with a sophisticated, generalization-aware metaheuristic for feature selection. We posit that while deep learning models, particularly those pre-trained on large-scale data (e.g., HuBERT, Wav2Vec2), can learn powerful and abstract feature representations, these features may still retain biases from their training data. Our core contribution is the design of a metaheuristic feature selection process guided by a novel fitness function that explicitly optimizes for generalization. This function evaluates candidate feature subsets not only on their accuracy on a source validation set but also on their performance stability across multiple, diverse validation sets, thereby promoting the selection of features that are invariant to inter-dataset variations. We outline a rigorous cross-corpus experimental protocol using datasets with diverse characteristics (e.g., IEMOCAP, EMO-DB, RAVDESS) to demonstrate the framework's ability to mitigate performance drop in cross-language and cross-condition scenarios. This research aims to provide a new pathway towards developing truly robust SER systems that can maintain reliable performance in the varied and unpredictable acoustic environments of the real world.

Authors

Publication Details

Published
2025-06-17
DOI
https://doi.org/10.38124/ijisrt/25jun755
Primary Topic
Emotion and Mood Recognition
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Mitigating Corpus Bias in Speech Emotion Recognition: A Robust Hybrid Framework using Generalization-Aware Metaheuristic Feature Selection

Satish R Sankaye, Irfan Chaugule
Emotion and Mood Recognition
article

Mitigating Corpus Bias in Speech Emotion Recognition: A Robust Hybrid Framework using Generalization-Aware Metaheuristic Feature Selection

Satish R Sankaye, Irfan Chaugule
article en

Abstract

A formidable challenge impeding the real-world deployment of Speech Emotion Recognition (SER) systems is the problem of corpus bias. Models trained on a specific speech dataset often experience a significant degradation in performance when tested on new, unseen data, which may differ in language, speaker demographics, recording conditions, and emotional expression styles. This lack of generalization severely limits the practical applicability of SER technology. This paper proposes a novel hybrid framework specifically designed to enhance cross-corpus robustness by integrating deep learning for feature extraction with a sophisticated, generalization-aware metaheuristic for feature selection. We posit that while deep learning models, particularly those pre-trained on large-scale data (e.g., HuBERT, Wav2Vec2), can learn powerful and abstract feature representations, these features may still retain biases from their training data. Our core contribution is the design of a metaheuristic feature selection process guided by a novel fitness function that explicitly optimizes for generalization. This function evaluates candidate feature subsets not only on their accuracy on a source validation set but also on their performance stability across multiple, diverse validation sets, thereby promoting the selection of features that are invariant to inter-dataset variations. We outline a rigorous cross-corpus experimental protocol using datasets with diverse characteristics (e.g., IEMOCAP, EMO-DB, RAVDESS) to demonstrate the framework's ability to mitigate performance drop in cross-language and cross-condition scenarios. This research aims to provide a new pathway towards developing truly robust SER systems that can maintain reliable performance in the varied and unpredictable acoustic environments of the real world.

Openalex Percentile: Top 86%
Emotion and Mood Recognition
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Mitigating Corpus Bias in Speech Emotion Recognition: A Robust Hybrid Framework using Generalization-Aware Metaheuristic Feature Selection — Satish R Sankaye, Irfan Chaugule · (2025) | TGRS Research Map | TGRS