Application of Machine Learning for the Detection of Audio Deep Fake

Strong detection procedures are crucial for preserving digital safety and reliability in light of the rapid development of deepfaketechnology, especially in the audio domain. Presenting a "Improved Deepfake Audio Detection using Spectro-Temporal Deep Learning Approach," our study attempts to tackle the growing problem of differentiating real audio from advanced deepfake alterations. In order to train and test a new deep learning model, our approach makes use of the extensive ADD2022 dataset. At its heart, our method is based on a painstaking data preparation step that involves resampling, normalizing, and silence removal of audio samples to make them consistent and improve the quality of the model input. An novel combination of Convolutional Neural Networks (CNNs) for spectral feature extraction and Recurrent Neural Networks (RNNs) or Long Short-Term Memory (LSTM) networks for temporal dynamics analysis is used in our deep learning model architecture. The complex irregularities seen in deepfake audios may be easily detected by this hybrid model. This research presents a method for detecting speech spoofing using Convolutional neural networks. The system uses many audio properties to distinguish between human and synthetic voices. In the worst-case scenario, unethical applications of deepfake audios meant to harm third parties might do widespread damage to national assets and reputations. An assailant may create convincing voiceovers by using a tiny audio sample of a real person. A 2D graph may be created using mathematical formulas to represent any audio stream. Converting audio files to pictures of audio features (Spectrogram, MFCC, FFT, STFT) before logging obtaining the array values in a numerical format that is best for feeding into a convolutional neural network (CNN) reduces the amount of computation needed to build a system that can detect deepfake voices. Predictions are made using both standalone and combined methods of entering data into the model.

Authors

Institutions

Publication Details

Published
2024-10-25
DOI
https://doi.org/10.1109/gccit63234.2024.10862652
Citations
1
Primary Topic
Digital Media Forensic Detection
Type
article
Field-Weighted Citation Impact
0.25
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Application of Machine Learning for the Detection of Audio Deep Fake

Vivek Saraswat, K. Divya, Gunjan Chhabra, Pallavi et al.
1 citations
Digital Media Forensic Detection
0.25
article

Application of Machine Learning for the Detection of Audio Deep Fake

Vivek Saraswat, K. Divya, Gunjan Chhabra, Pallavi, S. Hemelatha, S.A. Tiwaskar
article en
1 citations

Abstract

Strong detection procedures are crucial for preserving digital safety and reliability in light of the rapid development of deepfaketechnology, especially in the audio domain. Presenting a "Improved Deepfake Audio Detection using Spectro-Temporal Deep Learning Approach," our study attempts to tackle the growing problem of differentiating real audio from advanced deepfake alterations. In order to train and test a new deep learning model, our approach makes use of the extensive ADD2022 dataset. At its heart, our method is based on a painstaking data preparation step that involves resampling, normalizing, and silence removal of audio samples to make them consistent and improve the quality of the model input. An novel combination of Convolutional Neural Networks (CNNs) for spectral feature extraction and Recurrent Neural Networks (RNNs) or Long Short-Term Memory (LSTM) networks for temporal dynamics analysis is used in our deep learning model architecture. The complex irregularities seen in deepfake audios may be easily detected by this hybrid model. This research presents a method for detecting speech spoofing using Convolutional neural networks. The system uses many audio properties to distinguish between human and synthetic voices. In the worst-case scenario, unethical applications of deepfake audios meant to harm third parties might do widespread damage to national assets and reputations. An assailant may create convincing voiceovers by using a tiny audio sample of a real person. A 2D graph may be created using mathematical formulas to represent any audio stream. Converting audio files to pictures of audio features (Spectrogram, MFCC, FFT, STFT) before logging obtaining the array values in a numerical format that is best for feeding into a convolutional neural network (CNN) reduces the amount of computation needed to build a system that can detect deepfake voices. Predictions are made using both standalone and combined methods of entering data into the model.

Jain University (IN), Shri Venkateshwara University (IN), Graphic Era University (IN), Karpagam Academy of Higher Education (IN), Chitkara University (IN)
Openalex Percentile: Top 42%
Digital Media Forensic Detection
0.25
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.