Leveraging Transfer Learning for Speech Emotion Recognition Using ResNet50
This paper introduces a speech emotion recognition (SER) system based on transfer learning with ResNet50. It uses the deep hierarchical features of Mel spectrograms of speech signals to precisely classify emotions. We improve feature learning while ensuring computational efficiency by freezing the first 143 layers of ResNet50 and fine-tuning the last layers. The model is trained on the TESS dataset, which contains seven emotions: anger, disgust, fear, happiness, neutral, surprise, and sadness. With data augmentation and optimized hyperparameters, the suggested model obtains a classification accuracy of 98.60\%, surpassing traditional SER methods. The experimental results prove that transfer learning based on ResNet50 can greatly enhance the generalization and robustness of SER models, which makes it an ideal choice for real-world human-computer interaction applications.
Authors
- P Siva Prasad
- Veeranjaneyulu Janagam
Institutions
- Vignan's Foundation for Science, Technology & Research (IN)
Publication Details
- Journal
- Research Square
- Published
- 2026-11-19
- DOI
- https://doi.org/10.21203/rs.3.rs-11178272/v1
- Primary Topic
- Emotion and Mood Recognition
- Type
- preprint