DiTSinger: Scaling Singing Voice Synthesis with Diffusion Transformer and Implicit Alignment
Recent progress in diffusion-based Singing Voice Synthesis (SVS) demonstrates strong expressiveness but remains limited by data scarcity and model scalability. We introduce a two-stage pipeline: a compact seed set of human-sung recordings is constructed by pairing fixed melodies with diverse LLM-generated lyrics, and melody-specific models are trained to synthesize over 500 hours of high-quality Chinese singing data. Building on this corpus, we propose DiTSinger, a Diffusion Transformer with RoPE and qk-norm, systematically scaled in depth, width, and resolution for enhanced fidelity. Furthermore, we design an implicit alignment mechanism that obviates phoneme-level duration labels by constraining phoneme-to-acoustic attention within character-level spans, thereby improving robustness under noisy or uncertain alignments. Extensive experiments validate that our approach enables scalable, alignment-free, and high-fidelity SVS.
Authors
- Xiaofeng Guo (ORCID: https://orcid.org/0000-0002-7258-3060)
- Zepeng Du (ORCID: https://orcid.org/0000-0002-9595-2439)
- K.W.E. Cheng (ORCID: https://orcid.org/0000-0003-2615-5169)
- Pan Zhong
- Peng Liu (ORCID: https://orcid.org/0000-0001-6568-1335)
- Qiang Fu (ORCID: https://orcid.org/0000-0001-7780-7185)
- Linke Li
Institutions
- China Mobile (China) (CN)
Publication Details
- Published
- 2026-04-21
- DOI
- https://doi.org/10.1109/icassp55912.2026.11463059
- Primary Topic
- Speech Recognition and Synthesis
- Type
- article
- Field-Weighted Citation Impact
- 0.00