Detecting Deepfake Audio Using Spectrogram-Based Machine Learning Approaches

The increasing ability of deep learning models to produce realistic-sounding synthetic speech poses serious problems for privacy, public trust, and digital security. To counter this danger, we offer a methodology for identifying deepfake audio that is based on machine learning. We use three ensemble learning models (Random Forest, Gradient Boosting, and XGBoost) for classification after transforming speech samples into mel-spectrograms to extract time-frequency information. These models, which were trained on the Deep Voice dataset, which included a variety of actual and synthetic samples, were assessed using common metrics such as F1-score, accuracy, precision, and recall. At 99.32% accuracy, XGBoost performed better than the others. These findings show the promise of lightweight, interpretable machine learning methods for identifying fake audio and protecting media authentication, digital forensics, and cybersecurity applications.

Authors

Institutions

Publication Details

Journal
IEEE Access
Published
2025-01-01
DOI
https://doi.org/10.1109/access.2025.3602531
Citations
2
Primary Topic
Music and Audio Processing
Type
article
Field-Weighted Citation Impact
2.97
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Detecting Deepfake Audio Using Spectrogram-Based Machine Learning Approaches

Amit Kumar Bairwa, Ritushree Bohara
2 citations
IEEE Access
Music and Audio Processing
2.97
article

Detecting Deepfake Audio Using Spectrogram-Based Machine Learning Approaches

Amit Kumar Bairwa, Ritushree Bohara
article en
2 citations

Abstract

The increasing ability of deep learning models to produce realistic-sounding synthetic speech poses serious problems for privacy, public trust, and digital security. To counter this danger, we offer a methodology for identifying deepfake audio that is based on machine learning. We use three ensemble learning models (Random Forest, Gradient Boosting, and XGBoost) for classification after transforming speech samples into mel-spectrograms to extract time-frequency information. These models, which were trained on the Deep Voice dataset, which included a variety of actual and synthetic samples, were assessed using common metrics such as F1-score, accuracy, precision, and recall. At 99.32% accuracy, XGBoost performed better than the others. These findings show the promise of lightweight, interpretable machine learning methods for identifying fake audio and protecting media authentication, digital forensics, and cybersecurity applications.

IEEE AccessVol. 13
Machine Intelligence Research Institute (US), Manipal University Jaipur
Openalex Percentile: Top 8%
Music and Audio Processing
2.97
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.