Build LLM-Based Zero-Shot Streaming TTS System with Cosyvoice
LLM-based text-to-speech(TTS) system has becoming the new trend and SOTA due to its high naturalness and zero-shot capability. However, it relies heavily on training data, usually requires at least thousands hours of labeled audio. In this report, we describe how to use pretrained CosyVoice model, to develop a streaming TTS system which supports Indian English and Indian languages. Though the pretrained CosyVoice model has never seen such data, it shows good performance in both specific speaker TTS and zero-shot voice clone after finetuning with merely 280 hours data. Experiment on LIMMITS25 challenge shows that our system achieves 4.46/4.19/4.55 naturalness, and 4.29/4.34/4.27 similarity in track1/track2/track3 respectively, which ranked 1st in all tracks.
Authors
- Zhihao Du (ORCID: https://orcid.org/0000-0003-3509-9322)
- Huadai Liu
- Yuxuan Wang (ORCID: https://orcid.org/0000-0002-1649-6974)
- Hao Wang (ORCID: https://orcid.org/0000-0002-7688-2236)
- Tianyu Zhao (ORCID: https://orcid.org/0009-0004-2935-837X)
- X. R. Lyu (ORCID: https://orcid.org/0000-0001-5689-9578)
Publication Details
- Published
- 2025-03-12
- DOI
- https://doi.org/10.1109/icassp49660.2025.10890358
- Primary Topic
- Brain Tumor Detection and Classification
- Type
- article
- Field-Weighted Citation Impact
- 0.00