Deepfake Detection Using AI: A Review Of Audio, Visual And Audio–Visual Methods For Digital Forensics

Deepfakes are realistic manipulated images, videos and audio created with deep learning and generative models that can imitate a person's face, voice, expressions or movements. Although useful in entertainment and education, they are misused for misinformation, fake identities, fraud and reputational harm. This paper reviews AI-based deepfake detection across both visual and audio modalities. It explains generation methods, then examines visual detection from facial texture, lighting, eye and lip movement and inter-frame differences using convolutional and attention-based networks; generalizable detectors for fully synthetic images; audio detection from spectral and prosodic voice characteristics using anti-spoofing models; and audio–visual methods that detect mismatches between speech and lip motion. Benchmarks including FaceForensics++, ASVspoof and FakeAVCeleb are discussed. The detection process of collecting and preprocessing media, extracting features and applying machine learning or deep learning models is formalized in a five-layer architecture. Research gaps, objectives, a comparison of modalities and challenges such as generalization, compression, adversarial evasion and explainability for forensic use are presented. The review concludes that combining audio and visual evidence gives the most reliable detection for social media, journalism, banking, law enforcement and digital forensics.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-11-11
DOI
https://doi.org/10.5281/zenodo.24127826
Primary Topic
Digital Media Forensic Detection
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Deepfake Detection Using AI: A Review Of Audio, Visual And Audio–Visual Methods For Digital Forensics

Prof. S. K. Said, Prof. M. C. Kolse, Kokane Sanika Santosh
Zenodo (CERN European Organization for Nuclear Research)
Digital Media Forensic Detection
article

Deepfake Detection Using AI: A Review Of Audio, Visual And Audio–Visual Methods For Digital Forensics

Prof. S. K. Said, Prof. M. C. Kolse, Kokane Sanika Santosh
article en

Abstract

Deepfakes are realistic manipulated images, videos and audio created with deep learning and generative models that can imitate a person's face, voice, expressions or movements. Although useful in entertainment and education, they are misused for misinformation, fake identities, fraud and reputational harm. This paper reviews AI-based deepfake detection across both visual and audio modalities. It explains generation methods, then examines visual detection from facial texture, lighting, eye and lip movement and inter-frame differences using convolutional and attention-based networks; generalizable detectors for fully synthetic images; audio detection from spectral and prosodic voice characteristics using anti-spoofing models; and audio–visual methods that detect mismatches between speech and lip motion. Benchmarks including FaceForensics++, ASVspoof and FakeAVCeleb are discussed. The detection process of collecting and preprocessing media, extracting features and applying machine learning or deep learning models is formalized in a five-layer architecture. Research gaps, objectives, a comparison of modalities and challenges such as generalization, compression, adversarial evasion and explainability for forensic use are presented. The review concludes that combining audio and visual evidence gives the most reliable detection for social media, journalism, banking, law enforcement and digital forensics.

Zenodo (CERN European Organization for Nuclear Research)
Digital Media Forensic Detection
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon