Cloning Dialects: Recreating and Localizing Dialectal Voices

Voice cloning technologies can replicate not only a speaker's voice but also potentially their regional dialect. This study evaluates the ability of the ElevenLabs model eleven multilingual v2 to preserve German dialects during voice cloning. Using dialectal recordings from nine regions, we generated cloned samples under varying synthesis conditions and assessed them through a perceptual localization task with human listeners. Results show that standard cloning tends to erase regional features, while style transfer and modified orthographic input partially improve dialect recognizability. The findings highlight the need for regionally informed models and further research into the acoustic and perceptual dimensions of dialect cloning.

Authors

Institutions

Publication Details

Published
2025-07-20
DOI
https://doi.org/10.1109/procomm64814.2025.00075
Primary Topic
Linguistic Variation and Morphology
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Cloning Dialects: Recreating and Localizing Dialectal Voices

Ingo Siegert, Alfred Lameli, Hanna Fischer, Martha Schubert
Linguistic Variation and Morphology
article

Cloning Dialects: Recreating and Localizing Dialectal Voices

Ingo Siegert, Alfred Lameli, Hanna Fischer, Martha Schubert
article en

Abstract

Voice cloning technologies can replicate not only a speaker's voice but also potentially their regional dialect. This study evaluates the ability of the ElevenLabs model eleven multilingual v2 to preserve German dialects during voice cloning. Using dialectal recordings from nine regions, we generated cloned samples under varying synthesis conditions and assessed them through a perceptual localization task with human listeners. Results show that standard cloning tends to erase regional features, while style transfer and modified orthographic input partially improve dialect recognizability. The findings highlight the need for regionally informed models and further research into the acoustic and perceptual dimensions of dialect cloning.

Philipps University of Marburg (DE), University of Rostock (DE), Otto-von-Guericke-Universität Magdeburg (DE)
Openalex Percentile: Top 76%
Linguistic Variation and Morphology
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.