A Stable and Robust Emotional Voice Conversion Framework Using CycleGAN

Emotional Voice Conversion (EVC) aims to modify speech to convey various emotions while maintaining the speaker's identity and the content of their language. In this study, we propose a CycleGAN-based framework for EVC, specifically targeting the bidirectional transformation between neutral and sad emotional states. The approach integrates adversarial and cycle-consistency losses, enhanced by spectral normalization, to achieve stable and high-quality emotional conversion in the mel-spectrogram domain. The model is implemented using PyTorch and evaluated its performance on the CREMA-D and IEMOCAP datasets. The results demonstrate the effectiveness of our method, showing improved emotional expressiveness and perceptual quality measured by Mel-Cepstral Distortion (MCD) and cosine similarity. Compared to baseline models, our framework achieves superior performance, maintaining speaker identity while offering expressive and natural emotional transformations. These findings highlight the potential of our framework for applications in affective computing and human-computer interaction. Future work will focus on broadening the spectrum of emotions and enhance real-time capabilities.

Authors

Institutions

Publication Details

Published
2025-04-02
DOI
https://doi.org/10.23919/indiacom66777.2025.11115407
Primary Topic
Speech Recognition and Synthesis
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Stable and Robust Emotional Voice Conversion Framework Using CycleGAN

Anthony Varghese, Vaibhav Sharma, Vijay Kumar, Neetesh Bakshi
Speech Recognition and Synthesis
article

A Stable and Robust Emotional Voice Conversion Framework Using CycleGAN

Anthony Varghese, Vaibhav Sharma, Vijay Kumar, Neetesh Bakshi
article en

Abstract

Emotional Voice Conversion (EVC) aims to modify speech to convey various emotions while maintaining the speaker's identity and the content of their language. In this study, we propose a CycleGAN-based framework for EVC, specifically targeting the bidirectional transformation between neutral and sad emotional states. The approach integrates adversarial and cycle-consistency losses, enhanced by spectral normalization, to achieve stable and high-quality emotional conversion in the mel-spectrogram domain. The model is implemented using PyTorch and evaluated its performance on the CREMA-D and IEMOCAP datasets. The results demonstrate the effectiveness of our method, showing improved emotional expressiveness and perceptual quality measured by Mel-Cepstral Distortion (MCD) and cosine similarity. Compared to baseline models, our framework achieves superior performance, maintaining speaker identity while offering expressive and natural emotional transformations. These findings highlight the potential of our framework for applications in affective computing and human-computer interaction. Future work will focus on broadening the spectrum of emotions and enhance real-time capabilities.

Bharati Vidyapeeth (Deemed to be University) (IN)
Openalex Percentile: Top 89%
Speech Recognition and Synthesis
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.