A Chinese Expressive Long-dialogue Speech Dataset with Scripts
With the advancement of large-scale models, the demand for emotionally rich, long-context, and highly natural communication in human-computer interaction increases. However, the exploration of long-context or script-level speech conversation tasks remains limited due to the lack of specific supervised data. To address this, we introduce a three-stage data processing pipeline for creating a Chinese expressive long-dialogue speech dataset with scripts (CELSDS). We collect videos from TV series, manually annotate speaker information for each character, apply Optical Character Recognition (OCR) to extract speech content, annotate episode summaries, and use a large language model (LLM) to generate sentence-level scenario descriptions. To our knowledge, this is the first Chinese long-context dialogue dataset that incorporates speaker and content annotations, script-level episode summaries, and sentence-level scenario details. Using this dataset, we develop a baseline model for both speech-to-script and script-to-speech generation tasks. The annotations and data production code are open-sourced at: https://github.com/lijin0120/CELSDS.
Authors
- Tianrui Wang (ORCID: https://orcid.org/0009-0005-1517-9589)
- Jiahui Zhao (ORCID: https://orcid.org/0009-0001-0947-3184)
- Jin Li (ORCID: https://orcid.org/0000-0001-6606-6967)
- Jianwu Dang (ORCID: https://orcid.org/0000-0003-4504-5758)
- Longbiao Wang (ORCID: https://orcid.org/0000-0002-8094-6861)
- Jianrong Wang (ORCID: https://orcid.org/0000-0002-3930-7275)
- Meng Ge (ORCID: https://orcid.org/0000-0003-4251-0482)
- Chenrui Cui
Institutions
- Tianjin University (CN)
- Chinese Academy of Sciences (CN)
- Shenzhen Institutes of Advanced Technology (CN)
Publication Details
- Published
- 2025-03-12
- DOI
- https://doi.org/10.1109/icassp49660.2025.10890525
- Primary Topic
- Speech and dialogue systems
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Natural Science Foundation of China