Experts fail to reliably detect AI-generated histological data

AI-based methods to generate images have seen unprecedented advances in recent years challenging both image forensic and human perceptual capabilities. Accordingly, these methods are expected to play an increasingly important role in the fraudulent fabrication of data. This includes images with complicated intrinsic structures such as histological tissue samples, which are harder to forge manually. Here, we use stable diffusion, one of the most recent generative algorithms, to create such a set of artificial histological samples. In a large study with over 800 participants, we study the ability of human subjects to discriminate between these artificial and genuine histological images. Although they perform better than naive participants, we find that even experts fail to reliably identify fabricated data. While participant performance depends on the amount of training data used, even low quantities are sufficient to create convincing images, necessitating methods and policies to detect fabricated data in scientific publications.

Authors

Institutions

Publication Details

Journal
Scientific Reports
Published
2024-11-19
DOI
https://doi.org/10.1038/s41598-024-73913-8
Citations
11
Primary Topic
Cell Image Analysis Techniques
Type
article
Field-Weighted Citation Impact
7.29

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Experts fail to reliably detect AI-generated histological data

Vera A. Kulow, Stefanie Reuter, Jan Hartung, Michael Fähling et al.
11 citations
Scientific Reports
Cell Image Analysis Techniques
7.29
article

Experts fail to reliably detect AI-generated histological data

Vera A. Kulow, Stefanie Reuter, Jan Hartung, Michael Fähling, Cord Spreckelsen, Ralf Mrowka
article en
11 citations

Abstract

AI-based methods to generate images have seen unprecedented advances in recent years challenging both image forensic and human perceptual capabilities. Accordingly, these methods are expected to play an increasingly important role in the fraudulent fabrication of data. This includes images with complicated intrinsic structures such as histological tissue samples, which are harder to forge manually. Here, we use stable diffusion, one of the most recent generative algorithms, to create such a set of artificial histological samples. In a large study with over 800 participants, we study the ability of human subjects to discriminate between these artificial and genuine histological images. Although they perform better than naive participants, we find that even experts fail to reliably identify fabricated data. While participant performance depends on the amount of training data used, even low quantities are sufficient to create convincing images, necessitating methods and policies to detect fabricated data in scientific publications.

Scientific ReportsVol. 14(1)
University of Freiburg (DE), German Medical Association (DE), Humboldt-Universität zu Berlin (DE), Bernstein Center for Computational Neuroscience Freiburg (DE), Jena University Hospital (DE), Freie Universität Berlin (DE), Charité - Universitätsmedizin Berlin (DE)
Freistaat Thüringen, European Commission, Deutsche Forschungsgemeinschaft, European Regional Development Fund
Reduced inequalities
Openalex Percentile: Top 3%
Cell Image Analysis Techniques
7.29
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Experts fail to reliably detect AI-generated histological data — Vera A. Kulow, Stefanie Reuter, et al. · Scientific Reports (2024) | TGRS Research Map | TGRS