Enhancing Model Robustness for Deepfake Singing Voice Detection through Data Augmentation
The rapid advancements in artificial intelligence (AI) technologies for singing voice synthesis have revolutionized music production but introduced significant challenges, including the misuse of AI-generated voices for deepfake purposes. This study proposes a framework for detecting deepfake singing voices using data augmentation techniques, the Synthetic Minority Over- sampling Technique (SMOTE), time stretching, and time shifting, combined with RawNet-based waveform feature extraction integrated into the Audio Anti-Spoofing Using Integrated Spectro-Temporal Graph Attention Networks (AASIST) model. The method effectively captures subtle temporal and spectral artifacts, achieving an equal error rate (EER) of 10.39% on the SVDD SingFake 2024 dataset, outperforming baseline models. This work provides a robust solution to safeguard the authenticity of AI-generated singing voices in digital media.
Authors
- Masashi Unoki (ORCID: https://orcid.org/0000-0002-6605-2052)
- Khalid Zaman (ORCID: https://orcid.org/0009-0004-0809-7537)
- Anuwat Chaiwongyen
- Shogo Okada (ORCID: https://orcid.org/0000-0002-9260-0403)
- Kai Li (ORCID: https://orcid.org/0000-0001-8452-620X)
- Islam J. A. M. Samiul
Institutions
- Japan Advanced Institute of Science and Technology (JP)
Publication Details
- Journal
- Journal of Signal Processing
- Published
- 2025-10-31
- DOI
- https://doi.org/10.2299/jsp.29.221
- Primary Topic
- Music and Audio Processing
- Type
- article
- Field-Weighted Citation Impact
- 0.00