CCFormer: A cascaded transformer framework for precise temporal audio-visual deepfake localization

Audio-visual deepfake detection presents significant computational challenges in achieving precise temporal boundary localization beyond traditional binary classification approaches. This study presents CCFormer, a cascaded optimization framework that integrates ConvNeXt-V2 visual forgery detection with CrossFormer cross-modal localization for precise temporal forgery localization. The framework employs a two-stage strategy where ConvNeXt-V2 performs efficient suspicious segment screening through multi-scale spatiotemporal feature extraction, while CrossFormer achieves frame-level precision through multi-head cross-modal attention mechanisms for optimal audio-visual feature alignment. Experiments on the LAV-DF dataset demonstrate that CCFormer achieving 96.30 % [email protected] and 84.96 % [email protected] The framework achieves inference time of 23.4 ms per video, representing 58.1 % improvement over conventional end-to-end architectures. Ablation studies reveal that the CrossFormer module increases detection performance in high-precision IoU intervals by 153.4 % compared to the baseline methods. The optimization framework successfully transforms coarse-grained binary classification into precise temporal boundary localization,

Publication Details

Journal
Alexandria Engineering Journal
Published
2025-12-12
DOI
https://doi.org/10.1016/j.aej.2025.12.001
Primary Topic
Digital Media Forensic Detection
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

CCFormer: A cascaded transformer framework for precise temporal audio-visual deepfake localization

Alexandria Engineering Journal
Digital Media Forensic Detection
article

CCFormer: A cascaded transformer framework for precise temporal audio-visual deepfake localization

article en

Abstract

Audio-visual deepfake detection presents significant computational challenges in achieving precise temporal boundary localization beyond traditional binary classification approaches. This study presents CCFormer, a cascaded optimization framework that integrates ConvNeXt-V2 visual forgery detection with CrossFormer cross-modal localization for precise temporal forgery localization. The framework employs a two-stage strategy where ConvNeXt-V2 performs efficient suspicious segment screening through multi-scale spatiotemporal feature extraction, while CrossFormer achieves frame-level precision through multi-head cross-modal attention mechanisms for optimal audio-visual feature alignment. Experiments on the LAV-DF dataset demonstrate that CCFormer achieving 96.30 % [email protected] and 84.96 % [email protected] The framework achieves inference time of 23.4 ms per video, representing 58.1 % improvement over conventional end-to-end architectures. Ablation studies reveal that the CrossFormer module increases detection performance in high-precision IoU intervals by 153.4 % compared to the baseline methods. The optimization framework successfully transforms coarse-grained binary classification into precise temporal boundary localization,

Alexandria Engineering JournalVol. 134
Openalex Percentile: Top 38%
Digital Media Forensic Detection
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

CCFormer: A cascaded transformer framework for precise temporal audio-visual deepfake localization · Alexandria Engineering Journal (2025) | TGRS Research Map | TGRS