Personalized Learning of Tibetan Academic Mandarin Pronunciation Integrating Mask-GCT Voice CloningTechnology

This study proposes a personalized Mandarin pronunciation learning framework for Tibetan learners that integrates Mask‑GCT voice‑cloning technology as a back‑end data‑augmentation module. By leveraging deep neural networks, the voice‑cloning component reconstructs key speaker characteristics—timbre, intonation, and prosody—from limited samples, generating high‑fidelity, individualized speech data. These synthetic samples not only alleviate labeled‑data scarcity but also introduce diverse pronunciation scenarios, particularly modeling the tonal, vowel, and consonant errors characteristic of Tibetan students’ Mandarin production. Adjustable cloning parameters enable simulation of multiple error patterns and subtle phonetic variations, thereby enriching training data and enhancing the model’s capacity to detect, adapt to, and correct a wide range of pronunciation deviations. Experimental results demonstrate that our approach significantly improves error recognition accuracy and model generalization compared to baseline systems lacking voice‑cloning augmentation. The flexible, controllable synthesis process provides empirical support for targeted pronunciation remediation, offering a scalable methodology for assisting Tibetan learners in mastering academic Mandarin pronunciation.

Authors

Publication Details

Journal
Journal of Computer Science and Artificial Intelligence
Published
2025-05-29
DOI
https://doi.org/10.54097/ew3r3e84
Primary Topic
Speech Recognition and Synthesis
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Personalized Learning of Tibetan Academic Mandarin Pronunciation Integrating Mask-GCT Voice CloningTechnology

Zhenye Gan, Wenhao Wei
Journal of Computer Science and Artificial Intelligence
Speech Recognition and Synthesis
article

Personalized Learning of Tibetan Academic Mandarin Pronunciation Integrating Mask-GCT Voice CloningTechnology

Zhenye Gan, Wenhao Wei
article en

Abstract

This study proposes a personalized Mandarin pronunciation learning framework for Tibetan learners that integrates Mask‑GCT voice‑cloning technology as a back‑end data‑augmentation module. By leveraging deep neural networks, the voice‑cloning component reconstructs key speaker characteristics—timbre, intonation, and prosody—from limited samples, generating high‑fidelity, individualized speech data. These synthetic samples not only alleviate labeled‑data scarcity but also introduce diverse pronunciation scenarios, particularly modeling the tonal, vowel, and consonant errors characteristic of Tibetan students’ Mandarin production. Adjustable cloning parameters enable simulation of multiple error patterns and subtle phonetic variations, thereby enriching training data and enhancing the model’s capacity to detect, adapt to, and correct a wide range of pronunciation deviations. Experimental results demonstrate that our approach significantly improves error recognition accuracy and model generalization compared to baseline systems lacking voice‑cloning augmentation. The flexible, controllable synthesis process provides empirical support for targeted pronunciation remediation, offering a scalable methodology for assisting Tibetan learners in mastering academic Mandarin pronunciation.

Journal of Computer Science and Artificial IntelligenceVol. 3(2)
Openalex Percentile: Top 94%
Speech Recognition and Synthesis
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.