ATP-TTS: Adaptive Thresholding Pseudo-Labeling for Low-Resource Multi-Speaker Text-to-Speech
To address the challenge of high annotation costs in text-to-speech (TTS) generation, this paper introduces a semi-supervised learning framework specifically designed for low-resource TTS scenarios. The framework incorporates adaptive thresholding to select appropriate pseudo-labels and leverages automatic speech recognition (ASR) results, enhanced by contrastive learning perturbations, to predict latent representations. This approach improves the stability and effectiveness of pre-training, allowing for successful transfer learning with only a limited amount of labeled data. Experimental results demonstrate that the proposed method outperforms baseline models in both naturalness and speaker similarity.
Authors
- Chen Shen (ORCID: https://orcid.org/0000-0001-7212-4588)
- Feng Li (ORCID: https://orcid.org/0000-0003-2638-2185)
- Shuai Yuan (ORCID: https://orcid.org/0009-0000-1439-9858)
- Hanjin Yang
Institutions
- Donghua University (CN)
Publication Details
- Published
- 2025-03-12
- DOI
- https://doi.org/10.1109/icassp49660.2025.10889956
- Primary Topic
- Speech Recognition and Synthesis
- Type
- article
- Field-Weighted Citation Impact
- 0.00