A Real-World Robustness Evaluation of AI-Image Provenance: Comparing C2PA Content Credentials and the SynthID Watermark Across Consumer Editing and Social-Media Pipelines

It is now hard to tell whether an image was made by artificial intelligence. To help, providers add two kinds of signals to AI images. The first is C2PA "Content Credentials," a signed piece of metadata stored in the image file. The second is SynthID, an invisible watermark placed inside the pixels. Google uses both, and OpenAI added SynthID to its images in May 2026. What is not known is whether these signals survive when an image is used in ordinary ways. This paper tests that question with a simple, repeatable method. We take ten AI images (five from ChatGPT/DALL-E and five from Google Gemini) and pass each one through four everyday actions (a Canva export, a screenshot, a WhatsApp transfer, and an Instagram post), first one at a time and then in chains of several actions. At every step, we measure the C2PA metadata and the pixel change with two small open-source Python tools, and we check the SynthID watermark with both companies' own detectors: the Gemini app and OpenAI Verify. The C2PA metadata is removed by the first action every time (survival rate 0 across fifty post-processing checks). The SynthID watermark survives every action and every chain for both companies, when read by that company's own detector. The key result concerns detection: each detector reads only its own company's watermark, so no single public tool reads both, and a "not detected" answer cannot be trusted to mean "not AI." We conclude that metadata-based provenance does not work in real use, that the pixel watermark is robust for both companies, but that provenance still fails as a usable system because detection is split across companies with no shared detector.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-09-13
DOI
https://doi.org/10.5281/zenodo.22734203
Primary Topic
Scientific Computing and Data Management
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

A Real-World Robustness Evaluation of AI-Image Provenance: Comparing C2PA Content Credentials and the SynthID Watermark Across Consumer Editing and Social-Media Pipelines

Anand Sundaramoorthy
Zenodo (CERN European Organization for Nuclear Research)
Scientific Computing and Data Management
preprint

A Real-World Robustness Evaluation of AI-Image Provenance: Comparing C2PA Content Credentials and the SynthID Watermark Across Consumer Editing and Social-Media Pipelines

Anand Sundaramoorthy
preprint en

Abstract

It is now hard to tell whether an image was made by artificial intelligence. To help, providers add two kinds of signals to AI images. The first is C2PA "Content Credentials," a signed piece of metadata stored in the image file. The second is SynthID, an invisible watermark placed inside the pixels. Google uses both, and OpenAI added SynthID to its images in May 2026. What is not known is whether these signals survive when an image is used in ordinary ways. This paper tests that question with a simple, repeatable method. We take ten AI images (five from ChatGPT/DALL-E and five from Google Gemini) and pass each one through four everyday actions (a Canva export, a screenshot, a WhatsApp transfer, and an Instagram post), first one at a time and then in chains of several actions. At every step, we measure the C2PA metadata and the pixel change with two small open-source Python tools, and we check the SynthID watermark with both companies' own detectors: the Gemini app and OpenAI Verify. The C2PA metadata is removed by the first action every time (survival rate 0 across fifty post-processing checks). The SynthID watermark survives every action and every chain for both companies, when read by that company's own detector. The key result concerns detection: each detector reads only its own company's watermark, so no single public tool reads both, and a "not detected" answer cannot be trusted to mean "not AI." We conclude that metadata-based provenance does not work in real use, that the pixel watermark is robust for both companies, but that provenance still fails as a usable system because detection is split across companies with no shared detector.

Zenodo (CERN European Organization for Nuclear Research)
Scientific Computing and Data Management
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.