Kurdish end-to-end speech synthesis using deep neural networks

This article introduces an end-to-end text-to-speech (TTS) system for the low-resourced language of Central Kurdish (CK, also known as Sorani) and tackles the challenges associated with limited data availability. We have compiled a dataset suitable for end-to-end text-to-speech that includes 21 h of CK female voice paired with corresponding texts. To identify the optimal performing system, we employed Tacotron2, an end-to-end deep neural network for speech synthesis, in three training experiments. The process involves training Tacotron2 using a pre-trained English system, followed by training two models from scratch with full and intonationally balanced datasets. We evaluated the effectiveness of these models using Mean Opinion Score (MOS), a subjective evaluation metric. Our findings demonstrate that the model trained from scratch on the full CK dataset surpasses both the model trained with the intonationally balanced dataset and the model trained using a pre-trained English model in terms of naturalness and intelligibility by achieving a MOS of 4.78 out of 5.

Authors

Institutions

Publication Details

Journal
Natural Language Processing Journal
Published
2024-08-13
DOI
https://doi.org/10.1016/j.nlp.2024.100096
Citations
5
Primary Topic
Speech Recognition and Synthesis
Type
article
Field-Weighted Citation Impact
1.74
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Kurdish end-to-end speech synthesis using deep neural networks

Hadi Veisi, Sabat Salih Muhamad, Abdulhady Abas Abdullah, Farhad Rahimi et al.
5 citations
Natural Language Processing Journal
Speech Recognition and Synthesis
1.74
article

Kurdish end-to-end speech synthesis using deep neural networks

Hadi Veisi, Sabat Salih Muhamad, Abdulhady Abas Abdullah, Farhad Rahimi, Aso Mahmudi
article en
5 citations

Abstract

This article introduces an end-to-end text-to-speech (TTS) system for the low-resourced language of Central Kurdish (CK, also known as Sorani) and tackles the challenges associated with limited data availability. We have compiled a dataset suitable for end-to-end text-to-speech that includes 21 h of CK female voice paired with corresponding texts. To identify the optimal performing system, we employed Tacotron2, an end-to-end deep neural network for speech synthesis, in three training experiments. The process involves training Tacotron2 using a pre-trained English system, followed by training two models from scratch with full and intonationally balanced datasets. We evaluated the effectiveness of these models using Mean Opinion Score (MOS), a subjective evaluation metric. Our findings demonstrate that the model trained from scratch on the full CK dataset surpasses both the model trained with the intonationally balanced dataset and the model trained using a pre-trained English model in terms of naturalness and intelligibility by achieving a MOS of 4.78 out of 5.

Natural Language Processing JournalVol. 8
The University of Melbourne (AU), University of Tehran (IR), Islamic Azad University, Arak (IR), University of Kurdistan Hewler (IQ), Soran University (IQ)
Openalex Percentile: Top 13%
Speech Recognition and Synthesis
1.74
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Kurdish end-to-end speech synthesis using deep neural networks — Hadi Veisi, Sabat Salih Muhamad, et al. · Natural Language Processing Journal (2024) | TGRS Research Map | TGRS