Robust Multilingual Audio Deepfake Detection Through Hybrid Modeling
The increasing sophistication of AI-generated human voice poses a significant threat, demanding robust detection systems that can generalize effectively across diverse linguistic environments and synthesis techniques.In response to the SAFE Challenge, this paper introduces a novel approach to multilingual audio deepfake detection.Our primary contribution lies in the comprehensive study of deepfake detection using a multilingual speech corpus encompassing 17 languages and a broad spectrum of synthesis methods and acoustic conditions, designed to enable more realistic and challenging evaluations.To optimally utilize this diverse data, we propose a hybrid detection model that synergistically combines the strengths of end-to-end RawNet and AASIST architectures with language-agnostic representations learned from a multilingual selfsupervised learning model.Additionally, we explore the efficacy of RawBoost data augmentation in enhancing robustness against realworld noise.Our experimental evaluation demonstrates promising generalization in generated audio detection, achieving approximately 73% balanced accuracy across multilingual data and unseen synthesis algorithms.
Authors
- Candy Olivia Mawalim (ORCID: https://orcid.org/0000-0001-9853-8893)
- Masashi Unoki (ORCID: https://orcid.org/0000-0002-6605-2052)
- Y. D. Wang (ORCID: https://orcid.org/0000-0003-3625-0936)
- Shogo Okada (ORCID: https://orcid.org/0000-0002-9260-0403)
- Aulia Adila
Institutions
- Japan Advanced Institute of Science and Technology (JP)
Publication Details
- Published
- 2025-06-17
- DOI
- https://doi.org/10.1145/3733102.3736706
- Primary Topic
- Music and Audio Processing
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Japan Society for the Promotion of Science