Training Tacotron 2 for Text-to-Speech Synthesis in Kreole Language: Methodology and Audio Processing

This paper presents a methodology for training Tacotron 2 for text-to-speech synthesis in the Kreole language, aiming to improve access to textual information for visually impaired individuals. This paper discusses Tacotron 2’s architecture, reviews relevant literature, and presents experimental implementations. By synthesizing current research trends serves as a valuable resource for TTS advancement. We trained the Tacotron 2 model to map input text sequences to Mel-spectrograms representing speech segments using a dataset of 25 audio recordings matched to their corresponding text transcripts. Segmenting audio data, using Google Colab for model training, and using HiFi-GAN as a vocoder for audio synthesis were all parts of the training process. The completeness, repeatability, and clarity of the synthesized speech were assessed in the listening assessments. Tacotron 2 performed admirably, generating intelligible sounds for 13 of 25 words despite the small sample. This study addresses the future and focuses Tacotron 2’s promise in low-resource language environments.

Authors

Institutions

Publication Details

Published
2024-10-24
DOI
https://doi.org/10.1109/nextcomp63004.2024.10779830
Primary Topic
Speech Recognition and Synthesis
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Training Tacotron 2 for Text-to-Speech Synthesis in Kreole Language: Methodology and Audio Processing

Nuzhah Gooda Sahib, Kousraj Ujoodha, Gobin Rahimbux Baby
Speech Recognition and Synthesis
article

Training Tacotron 2 for Text-to-Speech Synthesis in Kreole Language: Methodology and Audio Processing

Nuzhah Gooda Sahib, Kousraj Ujoodha, Gobin Rahimbux Baby
article en

Abstract

This paper presents a methodology for training Tacotron 2 for text-to-speech synthesis in the Kreole language, aiming to improve access to textual information for visually impaired individuals. This paper discusses Tacotron 2’s architecture, reviews relevant literature, and presents experimental implementations. By synthesizing current research trends serves as a valuable resource for TTS advancement. We trained the Tacotron 2 model to map input text sequences to Mel-spectrograms representing speech segments using a dataset of 25 audio recordings matched to their corresponding text transcripts. Segmenting audio data, using Google Colab for model training, and using HiFi-GAN as a vocoder for audio synthesis were all parts of the training process. The completeness, repeatability, and clarity of the synthesized speech were assessed in the listening assessments. Tacotron 2 performed admirably, generating intelligible sounds for 13 of 25 words despite the small sample. This study addresses the future and focuses Tacotron 2’s promise in low-resource language environments.

University of Mauritius (MU)
Quality Education
Openalex Percentile: Top 79%
Speech Recognition and Synthesis
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Training Tacotron 2 for Text-to-Speech Synthesis in Kreole Language: Methodology and Audio Processing — Nuzhah Gooda Sahib, Kousraj Ujoodha, et al. · (2024) | TGRS Research Map | TGRS