Impact of Target Speech Length on Performance in Voice Conversion Modeling

In voice conversion (VC), which transforms acoustic characteristics of one voice (source speech) to another (target speech), it is essential to preserve the linguistic content of the source speech while accurately extracting style information from the target speech. However, in existing deep learning-based vc frameworks, introducing short target speech results in less reliable style extraction, leading to decreased performance. This paper presents a comprehensive analysis of the conversion performance of three state-of-the-art vc models with different network architectures, focusing on the impact of target speech duration. Our experiments demonstrate the impact of target speech length on speaker similarity and linguistic content intelli-gibility. Absolute scores and their variability differ depending on the specific neural frameworks of the vc models. These findings provide valuable insights for designing vc systems for applications with limited target speech duration.

Authors

Institutions

Publication Details

Published
2024-11-03
DOI
https://doi.org/10.1109/icce-asia63397.2024.10773691
Primary Topic
Speech Recognition and Synthesis
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Impact of Target Speech Length on Performance in Voice Conversion Modeling

Hojung Cha, Miseul Kim, Juhwan Yoon, Hong-Goo Kang
Speech Recognition and Synthesis
article

Impact of Target Speech Length on Performance in Voice Conversion Modeling

Hojung Cha, Miseul Kim, Juhwan Yoon, Hong-Goo Kang
article en

Abstract

In voice conversion (VC), which transforms acoustic characteristics of one voice (source speech) to another (target speech), it is essential to preserve the linguistic content of the source speech while accurately extracting style information from the target speech. However, in existing deep learning-based vc frameworks, introducing short target speech results in less reliable style extraction, leading to decreased performance. This paper presents a comprehensive analysis of the conversion performance of three state-of-the-art vc models with different network architectures, focusing on the impact of target speech duration. Our experiments demonstrate the impact of target speech length on speaker similarity and linguistic content intelli-gibility. Absolute scores and their variability differ depending on the specific neural frameworks of the vc models. These findings provide valuable insights for designing vc systems for applications with limited target speech duration.

Yonsei University (KR)
Openalex Percentile: Top 77%
Speech Recognition and Synthesis
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Impact of Target Speech Length on Performance in Voice Conversion Modeling — Hojung Cha, Miseul Kim, et al. · (2024) | TGRS Research Map | TGRS