Navigating the Soundscape of Deception: A Comprehensive Survey on Audio Deepfake Generation, Detection, and Future Horizons

The rise of audio deepfakes presents a significant security threat that undermines trust in digital communications and media. These synthetic audio technologies can convincingly mimic a person’s voice, enabling malicious activities like impersonation, fraud, and misinformation. Addressing this growing threat requires robust detection systems to ensure the authenticity of digital content. In this survey, we provide a comprehensive analysis of the state-of-the-art techniques in audio deepfake generation and detection. We examine various methods used to generate audio deepfakes, including Text-to-Speech (TTS) and Voice Conversion (VC) technologies, and discuss their capabilities in producing highly realistic synthetic audio. On the detection front, we explore a wide range of approaches, encompassing traditional machine learning and deep learning models for feature extraction and classification. The importance of publicly available datasets for training and evaluating these models is emphasized, showcasing their role in advancing detection capabilities. Additionally, the integration of audio and video deepfake detection systems is discussed, providing a comprehensive defense against sophisticated attacks. This survey critically assesses existing methods and datasets, highlighting challenges like the high realism of deepfakes, limited data diversity, and the need for models that generalize well. It aims to guide future research in enhancing detection and safeguarding digital media integrity.

Authors

Institutions

Publication Details

Journal
Foundations and Trends® in Privacy and Security
Published
2024-11-27
DOI
https://doi.org/10.1561/3300000048
Citations
11
Primary Topic
Digital Media Forensic Detection
Type
article
Field-Weighted Citation Impact
2.74
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Navigating the Soundscape of Deception: A Comprehensive Survey on Audio Deepfake Generation, Detection, and Future Horizons

Taiba Majid Wani, Irene Amerini, Syed Asif Ahmad Qadri, Farooq Ahmad Wani
11 citations
Foundations and Trends® in Privacy and Security
Digital Media Forensic Detection
2.74
article

Navigating the Soundscape of Deception: A Comprehensive Survey on Audio Deepfake Generation, Detection, and Future Horizons

Taiba Majid Wani, Irene Amerini, Syed Asif Ahmad Qadri, Farooq Ahmad Wani
article en
11 citations

Abstract

The rise of audio deepfakes presents a significant security threat that undermines trust in digital communications and media. These synthetic audio technologies can convincingly mimic a person’s voice, enabling malicious activities like impersonation, fraud, and misinformation. Addressing this growing threat requires robust detection systems to ensure the authenticity of digital content. In this survey, we provide a comprehensive analysis of the state-of-the-art techniques in audio deepfake generation and detection. We examine various methods used to generate audio deepfakes, including Text-to-Speech (TTS) and Voice Conversion (VC) technologies, and discuss their capabilities in producing highly realistic synthetic audio. On the detection front, we explore a wide range of approaches, encompassing traditional machine learning and deep learning models for feature extraction and classification. The importance of publicly available datasets for training and evaluating these models is emphasized, showcasing their role in advancing detection capabilities. Additionally, the integration of audio and video deepfake detection systems is discussed, providing a comprehensive defense against sophisticated attacks. This survey critically assesses existing methods and datasets, highlighting challenges like the high realism of deepfakes, limited data diversity, and the need for models that generalize well. It aims to guide future research in enhancing detection and safeguarding digital media integrity.

Foundations and Trends® in Privacy and SecurityVol. 6(3-4)
National Tsing Hua University (TW), Sapienza University of Rome (IT)
Openalex Percentile: Top 8%
Digital Media Forensic Detection
2.74
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.