Deepfake Voice Detection Using Convolutional Neural Networks: A Comprehensive Approach to Identifying Synthetic Audio

Deepfake voice recognition has lately been one of the critical challenges in the domain of cybersecurity and digital forensics, as it has recently become increasingly used with deep learning models to create absolutely indistinguishable audio imitations. This paper proposes a CNN-based approach to detect and classify deepfake audio clips. The model is trained on an exhaustive dataset that includes both real and deepfake voice records, putting much attention into the difference between natural and manipulated speech patterns. Our approach is based on the spectrogram analysis-a method of audio signal processing by converting it into a visual format that the CNN then analyzes to extract and categorize features. We test the performance of this model, which has gone through rigorous training with an accuracy of 82.6% and a test loss of 0.386. Results indicate that the proposed CNN architecture successfully learns nuanced acoustic variations between real and synthetic voices, setting up a robust framework for the detection of deepfakes. Moreover, the generalizability of the model has been checked multiple times, keeping the training and validation metrics very close. Future works will further improve the detection accuracy by including more pre-processing techniques and increasing the dataset with more varieties of deepfake sources. The study therefore adds to the ever-increasing demand for reliable and capable tools in the identification of audio forgeries, which seriously threatens privacy, security, and integrity of information in our time.

Authors

Institutions

Publication Details

Published
2024-12-06
DOI
https://doi.org/10.1109/ccis63231.2024.10931997
Citations
3
Primary Topic
Speech and Audio Processing
Type
article
Field-Weighted Citation Impact
1.05
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Deepfake Voice Detection Using Convolutional Neural Networks: A Comprehensive Approach to Identifying Synthetic Audio

Amanveer Singh, Eshika Jain
3 citations
Speech and Audio Processing
1.05
article

Deepfake Voice Detection Using Convolutional Neural Networks: A Comprehensive Approach to Identifying Synthetic Audio

Amanveer Singh, Eshika Jain
article en
3 citations

Abstract

Deepfake voice recognition has lately been one of the critical challenges in the domain of cybersecurity and digital forensics, as it has recently become increasingly used with deep learning models to create absolutely indistinguishable audio imitations. This paper proposes a CNN-based approach to detect and classify deepfake audio clips. The model is trained on an exhaustive dataset that includes both real and deepfake voice records, putting much attention into the difference between natural and manipulated speech patterns. Our approach is based on the spectrogram analysis-a method of audio signal processing by converting it into a visual format that the CNN then analyzes to extract and categorize features. We test the performance of this model, which has gone through rigorous training with an accuracy of 82.6% and a test loss of 0.386. Results indicate that the proposed CNN architecture successfully learns nuanced acoustic variations between real and synthetic voices, setting up a robust framework for the detection of deepfakes. Moreover, the generalizability of the model has been checked multiple times, keeping the training and validation metrics very close. Future works will further improve the detection accuracy by including more pre-processing techniques and increasing the dataset with more varieties of deepfake sources. The study therefore adds to the ever-increasing demand for reliable and capable tools in the identification of audio forgeries, which seriously threatens privacy, security, and integrity of information in our time.

Chitkara University (IN)
Openalex Percentile: Top 21%
Speech and Audio Processing
1.05
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.