Classical to Quantum Neural Network Transfer Learning Approach for Speech Emotion Recognition

Speech emotion recognition (SER) has gained utmost attention among researchers for its vital role in Human-Computer Interaction, enabling systems to understand and respond to the emotional states of the users. In this work, the concept of transfer learning has been extended to the novel domain of hybrid classical-quantum neural networks for enhancing SER performance. The classical part involves preprocessing raw speech signals to generate three-channel log mel-spectrograms and the pretrained VGG 19 network for extracting useful emotional features. The quantum part is built upon a dressed quantum neural network (QNN), comprising multiple parallel QNN blocks, for accurate emotion classification. Extensive experiments on the publicly accessible TESS dataset reveal that the proposed hybrid transfer learning approach achieves state of the art accuracy of 98.93 %. An ablation study demonstrates the significant performance improvement attributed to the incorporation of QNN blocks. The integration of classical and quantum neural networks provides a robust and efficient solution, leveraging the strengths of both computational paradigms to enhance SER based applications.

Authors

Institutions

Publication Details

Published
2024-12-01
DOI
https://doi.org/10.1109/tencon61640.2024.10902713
Citations
1
Primary Topic
Neural Networks and Applications
Type
article
Field-Weighted Citation Impact
0.35
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Classical to Quantum Neural Network Transfer Learning Approach for Speech Emotion Recognition

Sudeep Sarkar, Sheikh Iftekhar Ahmed, Mohammad Saquib, Shaikh Anowarul Fattah
1 citations
Neural Networks and Applications
0.35
article

Classical to Quantum Neural Network Transfer Learning Approach for Speech Emotion Recognition

Sudeep Sarkar, Sheikh Iftekhar Ahmed, Mohammad Saquib, Shaikh Anowarul Fattah
article en
1 citations

Abstract

Speech emotion recognition (SER) has gained utmost attention among researchers for its vital role in Human-Computer Interaction, enabling systems to understand and respond to the emotional states of the users. In this work, the concept of transfer learning has been extended to the novel domain of hybrid classical-quantum neural networks for enhancing SER performance. The classical part involves preprocessing raw speech signals to generate three-channel log mel-spectrograms and the pretrained VGG 19 network for extracting useful emotional features. The quantum part is built upon a dressed quantum neural network (QNN), comprising multiple parallel QNN blocks, for accurate emotion classification. Extensive experiments on the publicly accessible TESS dataset reveal that the proposed hybrid transfer learning approach achieves state of the art accuracy of 98.93 %. An ablation study demonstrates the significant performance improvement attributed to the incorporation of QNN blocks. The integration of classical and quantum neural networks provides a robust and efficient solution, leveraging the strengths of both computational paradigms to enhance SER based applications.

The University of Texas at Dallas (US), Bangladesh University of Engineering and Technology (BD)
Openalex Percentile: Top 29%
Neural Networks and Applications
0.35
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Classical to Quantum Neural Network Transfer Learning Approach for Speech Emotion Recognition — Sudeep Sarkar, Sheikh Iftekhar Ahmed, et al. · (2024) | TGRS Research Map | TGRS