Cloning Dialects: Recreating and Localizing Dialectal Voices
Voice cloning technologies can replicate not only a speaker's voice but also potentially their regional dialect. This study evaluates the ability of the ElevenLabs model eleven multilingual v2 to preserve German dialects during voice cloning. Using dialectal recordings from nine regions, we generated cloned samples under varying synthesis conditions and assessed them through a perceptual localization task with human listeners. Results show that standard cloning tends to erase regional features, while style transfer and modified orthographic input partially improve dialect recognizability. The findings highlight the need for regionally informed models and further research into the acoustic and perceptual dimensions of dialect cloning.
Authors
- Ingo Siegert (ORCID: https://orcid.org/0000-0001-7447-7141)
- Alfred Lameli
- Hanna Fischer
- Martha Schubert
Institutions
- Philipps University of Marburg (DE)
- University of Rostock (DE)
- Otto-von-Guericke-Universität Magdeburg (DE)
Publication Details
- Published
- 2025-07-20
- DOI
- https://doi.org/10.1109/procomm64814.2025.00075
- Primary Topic
- Linguistic Variation and Morphology
- Type
- article
- Field-Weighted Citation Impact
- 0.00