Expanded Voices: Voice Cloning, Latent Spaces, and Embodied Translation 30
Expanded Voices is an interactive installation that explores voice cloning through timbre transfer and latent space visualization. Developed through a collaboration between the Data Analytics and Visualization Group at the Barcelona Supercomputing Center and professional singer and artist Maria Arnal, the work allows participants to transform their voices into a trained vocal model while visually navigating the latent representations underlying the conversion. While not a translation system in the traditional linguistic sense, the installation reveals translational processes operating across representation and embodiment. Users report that converted voices sound perceptually native across multiple languages, even though the model is trained on a limited set of source languages. Motivated by this observation, we analyze the structure of phonetic latent spaces showing that speech from different languages organizes into shared patterns anchored in breath and articulation. By combining artistic practice, data analysis, and visualization, this work positions timbre transfer as a creative form of translation between bodies, languages, and machines, and demonstrates how latent spaces can function as interpretable bridges between human vocal production and computational representation.
Authors
- Tomás Andrade (ORCID: https://orcid.org/0000-0001-6000-1302)
- Guillermo Marin (ORCID: https://orcid.org/0000-0002-9742-3792)
- Fernando Cucchietti (ORCID: https://orcid.org/0000-0002-9027-1263)
- Mario Herrero-Valea (ORCID: https://orcid.org/0000-0003-2147-2392)
- Thaleia Ntiniakou (ORCID: https://orcid.org/0000-0001-6470-9885)
- Alex Gil Julian (ORCID: https://orcid.org/0000-0003-4851-6201)
- Othmane Hayoun-Mya (ORCID: https://orcid.org/0000-0001-8243-7051)
- Sara Tolosa-Alarcon (ORCID: https://orcid.org/0009-0002-8409-0834)
- Paula Fernández Vergara (ORCID: https://orcid.org/0009-0002-2032-7898)
- Adrià Espinoza Gómez (ORCID: https://orcid.org/0009-0007-5109-4886)
- Jerónimo Calderón (ORCID: https://orcid.org/0009-0009-8843-6506)
- Marc Heras Villacampa (ORCID: https://orcid.org/0009-0009-8965-7458)
- Roger Gonzalez March (ORCID: https://orcid.org/0009-0009-3551-1680)
- David Garcia-Povedano (ORCID: https://orcid.org/0000-0001-8398-8285)
- Raquel Barrachina Llobet (ORCID: https://orcid.org/0009-0002-0106-1983)
- Maria Arnal Dimas (ORCID: https://orcid.org/0009-0002-9724-4978)
- Paula Méndez Gordillo (ORCID: https://orcid.org/0009-0006-0679-6865)
- Sol Bucalo Mana (ORCID: https://orcid.org/0009-0007-6162-7973)
Institutions
- Barcelona Supercomputing Center (ES)
- Universitat Politècnica de Catalunya (ES)
Publication Details
- Journal
- Proceedings of the ACM on Computer Graphics and Interactive Techniques
- Published
- 2026-06-29
- DOI
- https://doi.org/10.1145/3816077
- Primary Topic
- Music Technology and Sound Studies
- Type
- article
- Field-Weighted Citation Impact
- 0.00