S človeško percepcijo podkrepljen razpoznavalnik globokih ponaredkov

The main challenge in deepfake detection is poor generalization to new and evolving manipulation methods. This thesis addresses this by integrating human visual perceptual cues as auxiliary supervision to guide more robust feature learning. To support this, a dataset combining Self-Blended Images (SBIs) with crowdsourced saliency maps and categorical inconsistency annotations was created. An EfficientNet-based multi-task model is trained to jointly perform deepfake classification and perception-driven tasks. Experiments on multiple benchmark datasets show that the model with a consecutive saliency map decoder trained on our dataset generalizes better than baseline detectors, indicating that localized human attention helps the network focus on stable, perceptually meaningful cues rather than method-specific artifacts.

Authors

Publication Details

Journal
Repository of the University of Ljubljana (University of Ljubljana)
Published
2026-01-06
Primary Topic
Generative Adversarial Networks and Image Synthesis
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

S človeško percepcijo podkrepljen razpoznavalnik globokih ponaredkov

Anja Hrvatič
Repository of the University of Ljubljana (University of Ljubljana)
Generative Adversarial Networks and Image Synthesis
article

S človeško percepcijo podkrepljen razpoznavalnik globokih ponaredkov

Anja Hrvatič
article en

Abstract

The main challenge in deepfake detection is poor generalization to new and evolving manipulation methods. This thesis addresses this by integrating human visual perceptual cues as auxiliary supervision to guide more robust feature learning. To support this, a dataset combining Self-Blended Images (SBIs) with crowdsourced saliency maps and categorical inconsistency annotations was created. An EfficientNet-based multi-task model is trained to jointly perform deepfake classification and perception-driven tasks. Experiments on multiple benchmark datasets show that the model with a consecutive saliency map decoder trained on our dataset generalizes better than baseline detectors, indicating that localized human attention helps the network focus on stable, perceptually meaningful cues rather than method-specific artifacts.

Repository of the University of Ljubljana (University of Ljubljana)
No poverty
Openalex Percentile: Top 94%
Generative Adversarial Networks and Image Synthesis
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.