ATP-TTS: Adaptive Thresholding Pseudo-Labeling for Low-Resource Multi-Speaker Text-to-Speech

To address the challenge of high annotation costs in text-to-speech (TTS) generation, this paper introduces a semi-supervised learning framework specifically designed for low-resource TTS scenarios. The framework incorporates adaptive thresholding to select appropriate pseudo-labels and leverages automatic speech recognition (ASR) results, enhanced by contrastive learning perturbations, to predict latent representations. This approach improves the stability and effectiveness of pre-training, allowing for successful transfer learning with only a limited amount of labeled data. Experimental results demonstrate that the proposed method outperforms baseline models in both naturalness and speaker similarity.

Authors

Institutions

Publication Details

Published
2025-03-12
DOI
https://doi.org/10.1109/icassp49660.2025.10889956
Primary Topic
Speech Recognition and Synthesis
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

ATP-TTS: Adaptive Thresholding Pseudo-Labeling for Low-Resource Multi-Speaker Text-to-Speech

Chen Shen, Feng Li, Shuai Yuan, Hanjin Yang
Speech Recognition and Synthesis
article

ATP-TTS: Adaptive Thresholding Pseudo-Labeling for Low-Resource Multi-Speaker Text-to-Speech

Chen Shen, Feng Li, Shuai Yuan, Hanjin Yang
article en

Abstract

To address the challenge of high annotation costs in text-to-speech (TTS) generation, this paper introduces a semi-supervised learning framework specifically designed for low-resource TTS scenarios. The framework incorporates adaptive thresholding to select appropriate pseudo-labels and leverages automatic speech recognition (ASR) results, enhanced by contrastive learning perturbations, to predict latent representations. This approach improves the stability and effectiveness of pre-training, allowing for successful transfer learning with only a limited amount of labeled data. Experimental results demonstrate that the proposed method outperforms baseline models in both naturalness and speaker similarity.

Donghua University (CN)
Openalex Percentile: Top 98%
Speech Recognition and Synthesis
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.