Classical to Quantum Neural Network Transfer Learning Approach for Speech Emotion Recognition
Speech emotion recognition (SER) has gained utmost attention among researchers for its vital role in Human-Computer Interaction, enabling systems to understand and respond to the emotional states of the users. In this work, the concept of transfer learning has been extended to the novel domain of hybrid classical-quantum neural networks for enhancing SER performance. The classical part involves preprocessing raw speech signals to generate three-channel log mel-spectrograms and the pretrained VGG 19 network for extracting useful emotional features. The quantum part is built upon a dressed quantum neural network (QNN), comprising multiple parallel QNN blocks, for accurate emotion classification. Extensive experiments on the publicly accessible TESS dataset reveal that the proposed hybrid transfer learning approach achieves state of the art accuracy of 98.93 %. An ablation study demonstrates the significant performance improvement attributed to the incorporation of QNN blocks. The integration of classical and quantum neural networks provides a robust and efficient solution, leveraging the strengths of both computational paradigms to enhance SER based applications.
Authors
- Sudeep Sarkar (ORCID: https://orcid.org/0000-0001-7332-4207)
- Sheikh Iftekhar Ahmed
- Mohammad Saquib (ORCID: https://orcid.org/0000-0002-9641-2397)
- Shaikh Anowarul Fattah
Institutions
- The University of Texas at Dallas (US)
- Bangladesh University of Engineering and Technology (BD)
Publication Details
- Published
- 2024-12-01
- DOI
- https://doi.org/10.1109/tencon61640.2024.10902713
- Citations
- 1
- Primary Topic
- Neural Networks and Applications
- Type
- article
- Field-Weighted Citation Impact
- 0.35