Whether to Use Pretrain Neural Vocoders or Not?: An Empirical Analysis for Indic Speech Synthesis

Existing speech synthesis systems are developed in German, Mandarin, or Japanese. However, languages, such as Indic and African lack such progress in building robust speech synthesis systems due to limited low-resource constraints (compared to language diversity). Manually creating a dataset specifically for these languages is time-consuming and costly. This paper conducts comprehensive experiments and evaluations of eight non-Indic pre-trained neural vocoders (PTNV) in six Indic languages and four dialects. We used subjective (NISQA Mean Opinion Score (MOS)), objective (Perceptual Evaluation of Speech Quality (PESQ), Mel-Cepstral Distortion (MCD), Mel-Spectra Distance (MSD), Short-Time Objective Intelligibility (STOI), Pearson Correlation Coefficient (PCC)) and quantitative (Word Error Rate (WER), Character Error Rate (CER)) measures to assess the generalization capabilities and performance of PTV models in Indic languages. During analysis, we noticed that architectural features, such as Multi-Receptive Fields (MRFs) and residual blocks, significantly improved the quality and intelligibility of the synthesized speech across diverse Indic languages. In particular, vocoders HiFi-GAN and UnivNet gave superior generalization and perceptual quality, despite being trained on non-indic datasets. Which suggests strong cross-lingual capabilities when combined with proper conditioning and architectural robustness.

Authors

Institutions

Publication Details

Published
2025-08-03
DOI
https://doi.org/10.1109/ialp68296.2024.11156270
Primary Topic
Speech and dialogue systems
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Whether to Use Pretrain Neural Vocoders or Not?: An Empirical Analysis for Indic Speech Synthesis

Hemant A. Patil, Ravindrakumar M. Purohit
Speech and dialogue systems
article

Whether to Use Pretrain Neural Vocoders or Not?: An Empirical Analysis for Indic Speech Synthesis

Hemant A. Patil, Ravindrakumar M. Purohit
article en

Abstract

Existing speech synthesis systems are developed in German, Mandarin, or Japanese. However, languages, such as Indic and African lack such progress in building robust speech synthesis systems due to limited low-resource constraints (compared to language diversity). Manually creating a dataset specifically for these languages is time-consuming and costly. This paper conducts comprehensive experiments and evaluations of eight non-Indic pre-trained neural vocoders (PTNV) in six Indic languages and four dialects. We used subjective (NISQA Mean Opinion Score (MOS)), objective (Perceptual Evaluation of Speech Quality (PESQ), Mel-Cepstral Distortion (MCD), Mel-Spectra Distance (MSD), Short-Time Objective Intelligibility (STOI), Pearson Correlation Coefficient (PCC)) and quantitative (Word Error Rate (WER), Character Error Rate (CER)) measures to assess the generalization capabilities and performance of PTV models in Indic languages. During analysis, we noticed that architectural features, such as Multi-Receptive Fields (MRFs) and residual blocks, significantly improved the quality and intelligibility of the synthesized speech across diverse Indic languages. In particular, vocoders HiFi-GAN and UnivNet gave superior generalization and perceptual quality, despite being trained on non-indic datasets. Which suggests strong cross-lingual capabilities when combined with proper conditioning and architectural robustness.

Dhirubhai Ambani University (IN)
Openalex Percentile: Top 87%
Speech and dialogue systems
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Whether to Use Pretrain Neural Vocoders or Not?: An Empirical Analysis for Indic Speech Synthesis — Hemant A. Patil, Ravindrakumar M. Purohit · (2025) | TGRS Research Map | TGRS