What Counts as a Real Photo? A Systematic Audit of Decision Thresholds, Real-Photo Provenance and Camera Pipelines in AI-Generated Image Detection — Systematic Review Protocol (v1.0)

Protocol (v1.0, 2026-11-01) for a two-level systematic review of AI-generated image detection, registered before screening. Level 1 audits evaluation practice in peer-reviewed papers (2022–2026) from a pre-specified list of leading venues: how decision thresholds are chosen and whether they are independent of the test data, whether false-positive rates on real photographs are reported at a pre-fixed threshold, how the provenance and processing of real photographs are described, and whether the threshold rule applied in public code matches the rule described in the paper. The primary outcome is the proportion of papers for which it can be established, from located evidence, that a false-positive rate on real photographs of described provenance was obtained at a threshold fixed independently of the test data. Level 2 synthesises studies that evaluate detectors on real photographs whose capture or processing chain is known or controlled (in-camera processing, post-capture processing, generative editing). A reproducible re-analysis of public detector scores illustrates how conclusions change under three threshold rules. Files: protocol, fixed AI screening prompt, coding manual (v0.3) and extraction forms. Reporting follows PRISMA-P, PRISMA 2020 and PRISMA-S. No funding.

Authors

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-11-01
DOI
https://doi.org/10.5281/zenodo.23862255
Primary Topic
Digital Media Forensic Detection
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

What Counts as a Real Photo? A Systematic Audit of Decision Thresholds, Real-Photo Provenance and Camera Pipelines in AI-Generated Image Detection — Systematic Review Protocol (v1.0)

Mohammed Mahdaoui
2 links
Zenodo (CERN European Organization for Nuclear Research)
Digital Media Forensic Detection
article

What Counts as a Real Photo? A Systematic Audit of Decision Thresholds, Real-Photo Provenance and Camera Pipelines in AI-Generated Image Detection — Systematic Review Protocol (v1.0)

Mohammed Mahdaoui
article en

Abstract

Protocol (v1.0, 2026-11-01) for a two-level systematic review of AI-generated image detection, registered before screening. Level 1 audits evaluation practice in peer-reviewed papers (2022–2026) from a pre-specified list of leading venues: how decision thresholds are chosen and whether they are independent of the test data, whether false-positive rates on real photographs are reported at a pre-fixed threshold, how the provenance and processing of real photographs are described, and whether the threshold rule applied in public code matches the rule described in the paper. The primary outcome is the proportion of papers for which it can be established, from located evidence, that a false-positive rate on real photographs of described provenance was obtained at a threshold fixed independently of the test data. Level 2 synthesises studies that evaluate detectors on real photographs whose capture or processing chain is known or controlled (in-camera processing, post-capture processing, generative editing). A reproducible re-analysis of public detector scores illustrates how conclusions change under three threshold rules. Files: protocol, fixed AI screening prompt, coding manual (v0.3) and extraction forms. Reporting follows PRISMA-P, PRISMA 2020 and PRISMA-S. No funding.

Zenodo (CERN European Organization for Nuclear Research)
Sidi Mohamed Ben Abdellah University (MA)
Openalex Percentile: Top 17%
Digital Media Forensic Detection
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon