Exemplar-Based Methods for Mandarin Electrolaryngeal Speech Voice Conversion

Electrolarynx (EL) can restore speech to patients without vocal cords, but the resulting speech often lacks naturalness and intelligibility. Inspired by recent advances in exemplar-based methods for speaker voice conversion (VC), this study explores their application to electrolaryngeal speech voice conversion (ELVC). As a baseline, we apply the k-nearest neighbors VC (KNN-VC) method with self-supervised learning (SSL) representations to ELVC. To circumvent the SSL feature mismatch between EL speech and natural speech when applying KNN-VC to ELVC, we propose two meth-ods under the parallel VC setting: the parallel KNN-ELVC method and the parallel locally linear embedding (LLE)-based ELVC method. Experimental results demonstrate that while directly applying KNN-VC to ELVC improves the naturalness of EL speech, our proposed methods, especially LLE-ELVC, significantly improve both naturalness and in-telligibility. Furthermore, LLE-ELVC is comparable to our previous deep-learning-based ELVC method, further demon-strating the potential of exemplar-based methods in ELVC tasks.

Authors

Institutions

Publication Details

Published
2024-10-17
DOI
https://doi.org/10.1109/o-cocosda64382.2024.10800247
Citations
2
Primary Topic
Speech Recognition and Synthesis
Type
article
Field-Weighted Citation Impact
0.69

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Exemplar-Based Methods for Mandarin Electrolaryngeal Speech Voice Conversion

Ming-Chi Yen, Chia-Hua Wu, Yu Tsao, Hsin‐Min Wang et al.
2 citations
Speech Recognition and Synthesis
0.69
article

Exemplar-Based Methods for Mandarin Electrolaryngeal Speech Voice Conversion

Ming-Chi Yen, Chia-Hua Wu, Yu Tsao, Hsin‐Min Wang, Hsin-Te Hwang
article en
2 citations

Abstract

Electrolarynx (EL) can restore speech to patients without vocal cords, but the resulting speech often lacks naturalness and intelligibility. Inspired by recent advances in exemplar-based methods for speaker voice conversion (VC), this study explores their application to electrolaryngeal speech voice conversion (ELVC). As a baseline, we apply the k-nearest neighbors VC (KNN-VC) method with self-supervised learning (SSL) representations to ELVC. To circumvent the SSL feature mismatch between EL speech and natural speech when applying KNN-VC to ELVC, we propose two meth-ods under the parallel VC setting: the parallel KNN-ELVC method and the parallel locally linear embedding (LLE)-based ELVC method. Experimental results demonstrate that while directly applying KNN-VC to ELVC improves the naturalness of EL speech, our proposed methods, especially LLE-ELVC, significantly improve both naturalness and in-telligibility. Furthermore, LLE-ELVC is comparable to our previous deep-learning-based ELVC method, further demon-strating the potential of exemplar-based methods in ELVC tasks.

Research Center for Information Technology Innovation, Academia Sinica (TW), Institute of Information Science, Academia Sinica (TW)
Nagoya University
Openalex Percentile: Top 22%
Speech Recognition and Synthesis
0.69
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Exemplar-Based Methods for Mandarin Electrolaryngeal Speech Voice Conversion — Ming-Chi Yen, Chia-Hua Wu, et al. · (2024) | TGRS Research Map | TGRS