Dual Acoustic Feature Fusion for Enhanced Audio Deepfake Detection Using VGG-16 Architecture: Mitigating Speech Tampering with MFCC and ELTP

In recent years, the rise of audio deepfakes, where artificial intelligence (AI) is used to manipulate or synthesize speech, has posed significant challenges in distinguishing between authentic and falsified audio content. Despite advancements in detection methods, current systems often struggle with accurately identifying deepfakes due to the complexity of modern voice cloning technologies. This study addresses this gap by proposing a novel dual-input convolutional neural network (CNN) model utilizing Mel-Frequency Cepstral Coefficients (MFCC) and Extended Local Ternary Patterns (ELTP) for enhanced audio forgery detection. Here, we present a system based on the VGG-16 architecture, which integrates MFCC and ELTP features to detect manipulated audio with high accuracy. Our approach achieves a detection accuracy of 94.21% on the Fake-or-Real and ASVspoof 2019 datasets, demonstrating a robust improvement over existing single-feature methods. These results suggest that combining MFCC and ELTP features can better capture both the spectral and textural properties of audio, leading to more reliable detection of audio tampering. This advancement has important implications for cybersecurity and the integrity of voice-based authentication systems, providing a stronger defense against potential fraud and misinformation through audio deepfakes.

Authors

Institutions

Publication Details

Published
2024-12-21
DOI
https://doi.org/10.1109/rivf64335.2024.11009070
Primary Topic
Speech and Audio Processing
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Dual Acoustic Feature Fusion for Enhanced Audio Deepfake Detection Using VGG-16 Architecture: Mitigating Speech Tampering with MFCC and ELTP

Candra Ahmadi, Siao-He Wang, Shih-Ping Chiu, Jiann-Liang Chen
Speech and Audio Processing
article

Dual Acoustic Feature Fusion for Enhanced Audio Deepfake Detection Using VGG-16 Architecture: Mitigating Speech Tampering with MFCC and ELTP

Candra Ahmadi, Siao-He Wang, Shih-Ping Chiu, Jiann-Liang Chen
article en

Abstract

In recent years, the rise of audio deepfakes, where artificial intelligence (AI) is used to manipulate or synthesize speech, has posed significant challenges in distinguishing between authentic and falsified audio content. Despite advancements in detection methods, current systems often struggle with accurately identifying deepfakes due to the complexity of modern voice cloning technologies. This study addresses this gap by proposing a novel dual-input convolutional neural network (CNN) model utilizing Mel-Frequency Cepstral Coefficients (MFCC) and Extended Local Ternary Patterns (ELTP) for enhanced audio forgery detection. Here, we present a system based on the VGG-16 architecture, which integrates MFCC and ELTP features to detect manipulated audio with high accuracy. Our approach achieves a detection accuracy of 94.21% on the Fake-or-Real and ASVspoof 2019 datasets, demonstrating a robust improvement over existing single-feature methods. These results suggest that combining MFCC and ELTP features can better capture both the spectral and textural properties of audio, leading to more reliable detection of audio tampering. This advancement has important implications for cybersecurity and the integrity of voice-based authentication systems, providing a stronger defense against potential fraud and misinformation through audio deepfakes.

National Taiwan University of Science and Technology (TW)
Openalex Percentile: Top 67%
Speech and Audio Processing
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.