Does Current Deepfake Audio Detection Model Effectively Detect ALM-Based Deepfake Audio?
Currently, Audio Language Models (ALMs) are rapidly advancing due to the developments in large language models and audio neural codecs. These ALMs have significantly lowered the bar-rier to creating deepfake audio, generating highly realistic and diverse types of deepfake audio, which pose severe threats to society. Consequently, effective audio deepfake detection tech-nologies to detect ALM-based audio have become increasingly critical. This paper investigate the effectiveness of current coun-termeasure (CM) against ALM-based audio. Specifically, we collect 12 types of the latest ALM-based deepfake audio and utilizing the latest CMs to evaluate. Our findings reveal that the latest codec-trained CM can effectively detect ALM-based audio, achieving 0% equal error rate under most ALM test conditions' which exceeded our expectations. This indicates promising directions for future research in ALM-based deepfake audio detection.
Authors
- Yuankun Xie (ORCID: https://orcid.org/0000-0002-8366-9011)
- Ruibo Fu (ORCID: https://orcid.org/0000-0001-9598-1881)
- Zhiyong Wang (ORCID: https://orcid.org/0000-0002-4956-1541)
- Long Ye (ORCID: https://orcid.org/0000-0002-3562-5612)
- Xiaopeng Wang (ORCID: https://orcid.org/0000-0003-1343-5823)
- Xin Qi (ORCID: https://orcid.org/0000-0002-9204-6457)
- Yukun Liu (ORCID: https://orcid.org/0000-0003-2994-5393)
- Guanjun Li (ORCID: https://orcid.org/0000-0002-8200-5360)
- Yi Lu (ORCID: https://orcid.org/0000-0002-0912-7724)
- Chenxu Xiong
- Zhengqi Wen
- Jianhua Tao (ORCID: https://orcid.org/0000-0002-9344-6428)
Institutions
- Shandong University (CN)
- Chinese Academy of Sciences (CN)
- University of Chinese Academy of Sciences (CN)
- State Key Laboratory of Media Convergence and Communication
- Communication University of China (CN)
- Tsinghua University (CN)
Publication Details
- Published
- 2024-11-07
- DOI
- https://doi.org/10.1109/iscslp63861.2024.10800375
- Citations
- 1
- Primary Topic
- Music and Audio Processing
- Type
- article
- Field-Weighted Citation Impact
- 0.35
Funders
- National Natural Science Foundation of China