Exemplar-Based Methods for Mandarin Electrolaryngeal Speech Voice Conversion
Electrolarynx (EL) can restore speech to patients without vocal cords, but the resulting speech often lacks naturalness and intelligibility. Inspired by recent advances in exemplar-based methods for speaker voice conversion (VC), this study explores their application to electrolaryngeal speech voice conversion (ELVC). As a baseline, we apply the k-nearest neighbors VC (KNN-VC) method with self-supervised learning (SSL) representations to ELVC. To circumvent the SSL feature mismatch between EL speech and natural speech when applying KNN-VC to ELVC, we propose two meth-ods under the parallel VC setting: the parallel KNN-ELVC method and the parallel locally linear embedding (LLE)-based ELVC method. Experimental results demonstrate that while directly applying KNN-VC to ELVC improves the naturalness of EL speech, our proposed methods, especially LLE-ELVC, significantly improve both naturalness and in-telligibility. Furthermore, LLE-ELVC is comparable to our previous deep-learning-based ELVC method, further demon-strating the potential of exemplar-based methods in ELVC tasks.
Authors
- Ming-Chi Yen
- Chia-Hua Wu
- Yu Tsao (ORCID: https://orcid.org/0000-0001-6956-0418)
- Hsin‐Min Wang (ORCID: https://orcid.org/0000-0003-3599-5071)
- Hsin-Te Hwang
Institutions
- Research Center for Information Technology Innovation, Academia Sinica (TW)
- Institute of Information Science, Academia Sinica (TW)
Publication Details
- Published
- 2024-10-17
- DOI
- https://doi.org/10.1109/o-cocosda64382.2024.10800247
- Citations
- 2
- Primary Topic
- Speech Recognition and Synthesis
- Type
- article
- Field-Weighted Citation Impact
- 0.69
Funders
- Nagoya University