Evaluation of possibly fabricated references in 500,000 science, engineering, and computing papers

References to nonexistent studies are well documented in biomedical research, but evidence outside biomedicine is limited. We analyzed a stratified random sample of 500,000 peer-reviewed journal papers in chemistry, physics, materials science, engineering, and computer science published from January 2023 through March 31, 2026, using OpenAlex, a large open index of scholarly works and citations. Our automated pipeline classified 1,135 references across 619 papers as fabricated, with 85.8% precision on masked expert review; fabricated is an operational label for a claimed title that could not be located in any of seven bibliographic and open-web sources. Affected-paper prevalence rose from 1 in 1,600 (6.3 per 10,000) in 2023 to 1 in 435 (23.0 per 10,000) in the first quarter of 2026, and full-period rates differed roughly sixfold across fields, from 25.6 per 10,000 papers in physics to 4.3 in chemistry. Most affected papers contained one or two fabricated references, but the 27 papers containing five or more accounted for more than a third of all fabricated references identified. Applying each field's rate to the approximately 7 million OpenAlex papers indexed in these fields gives an estimated 8,500 papers carrying at least one fabricated reference. Routine automated reference verification at submission, together with retrospective screening of the published literature, can detect fabricated references before and after they enter the scientific record.

Authors

Institutions

Publication Details

Journal
Proceedings of the National Academy of Sciences
Published
2026-10-26
DOI
https://doi.org/10.1073/pnas.2623869123
Primary Topic
Academic integrity and plagiarism
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Evaluation of possibly fabricated references in 500,000 science, engineering, and computing papers

Maxim Topaz, Pallavi Gupta, Zhihong Zhang, Laura‐Maria Peltonen
Proceedings of the National Academy of Sciences
Academic integrity and plagiarism
article

Evaluation of possibly fabricated references in 500,000 science, engineering, and computing papers

Maxim Topaz, Pallavi Gupta, Zhihong Zhang, Laura‐Maria Peltonen
article en

Abstract

References to nonexistent studies are well documented in biomedical research, but evidence outside biomedicine is limited. We analyzed a stratified random sample of 500,000 peer-reviewed journal papers in chemistry, physics, materials science, engineering, and computer science published from January 2023 through March 31, 2026, using OpenAlex, a large open index of scholarly works and citations. Our automated pipeline classified 1,135 references across 619 papers as fabricated, with 85.8% precision on masked expert review; fabricated is an operational label for a claimed title that could not be located in any of seven bibliographic and open-web sources. Affected-paper prevalence rose from 1 in 1,600 (6.3 per 10,000) in 2023 to 1 in 435 (23.0 per 10,000) in the first quarter of 2026, and full-period rates differed roughly sixfold across fields, from 25.6 per 10,000 papers in physics to 4.3 in chemistry. Most affected papers contained one or two fabricated references, but the 27 papers containing five or more accounted for more than a third of all fabricated references identified. Applying each field's rate to the approximately 7 million OpenAlex papers indexed in these fields gives an estimated 8,500 papers carrying at least one fabricated reference. Routine automated reference verification at submission, together with retrospective screening of the published literature, can detect fabricated references before and after they enter the scientific record.

Proceedings of the National Academy of SciencesVol. 123(44)
VNS Health (US), University of Turku (FI), University of Eastern Finland (FI), Columbia University (US)
Openalex Percentile: Top 8%
Academic integrity and plagiarism
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon
Evaluation of possibly fabricated references in 500,000 science, engineering, and computing papers — Maxim Topaz, Pallavi Gupta, et al. · Proceedings of the National Academy of Sciences (2026) | TGRS Research Map | TGRS