NLPP: A Natural Language Prosodic Prominence Dataset Assisted by ChatGPT

Recent advancements in speech synthesis, leveraging deep learning and vast datasets, have largely addressed accuracy and fluency concerns. However, expressive speech synthesis, aiming for nuanced styles like emotion and pace, remains a challenge. Prior methods relying on categorical labels or short prompts limit authenticity. Addressing this, recent approaches incorporate natural language prompts for flexibility and ease of use. In this paper, we present NLPP, a novel dataset describing prosodic prominence through natural language with the assisting of ChatGPT. The experimental results demonstrate the rich-ness and accuracy of NLPP in description. NLPP pioneers natural language descriptions of prosodic prominence, facilitating more authentic expressive speech synthesis. Meanwhile, NLPP also serve as a processing paradigm for related tasks.

Authors

Institutions

Publication Details

Published
2024-11-07
DOI
https://doi.org/10.1109/iscslp63861.2024.10800167
Primary Topic
Speech and dialogue systems
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

NLPP: A Natural Language Prosodic Prominence Dataset Assisted by ChatGPT

Rui Niu, Changhe Song, Zhiyong Wu
Speech and dialogue systems
article

NLPP: A Natural Language Prosodic Prominence Dataset Assisted by ChatGPT

Rui Niu, Changhe Song, Zhiyong Wu
article en

Abstract

Recent advancements in speech synthesis, leveraging deep learning and vast datasets, have largely addressed accuracy and fluency concerns. However, expressive speech synthesis, aiming for nuanced styles like emotion and pace, remains a challenge. Prior methods relying on categorical labels or short prompts limit authenticity. Addressing this, recent approaches incorporate natural language prompts for flexibility and ease of use. In this paper, we present NLPP, a novel dataset describing prosodic prominence through natural language with the assisting of ChatGPT. The experimental results demonstrate the rich-ness and accuracy of NLPP in description. NLPP pioneers natural language descriptions of prosodic prominence, facilitating more authentic expressive speech synthesis. Meanwhile, NLPP also serve as a processing paradigm for related tasks.

University Town of Shenzhen (CN), Tsinghua University (CN)
Quality Education
Openalex Percentile: Top 78%
Speech and dialogue systems
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.