“The paper I wish I had written with Giacinto Scoles,” the cherry-picking of data, and other reflections on reproducibility issues

While most scientists work ethically, science is dealing with serious issues related to experimental replication, data quality, and literature completeness, which are often addressed under the heading of a reproducibility crisis. For example, as much as 90% of all biomedical research may be irreproducible and up to 30% of it is fraudulent. In surface analysis, 40% of the x-ray photoelectron spectroscopy data analysis (peak fitting) in the scientific literature may be incorrect and another 40% of it is suspect. We present and discuss five aspects of the reproducibility crisis: how our biases and preconceived notions affect what we publish, cherry-picking of data, the value of collaboration, linking related articles including with commentary by artificial intelligence (AI), and data availability and analysis transparency. Perspectives in this article come from surface science, biological sciences, and educational publishing. What and how we select materials for publishing has a significant impact on reproducibility challenges, particularly with the expanding uses of AI.

Authors

Institutions

Publication Details

Journal
Journal of Vacuum Science & Technology A Vacuum Surfaces and Films
Published
2026-03-16
DOI
https://doi.org/10.1116/6.0005156
Primary Topic
Scientific Computing and Data Management
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

“The paper I wish I had written with Giacinto Scoles,” the cherry-picking of data, and other reflections on reproducibility issues

Joshua W. Pinder, Matthew R. Linford, Donald Baer, J. S. Price et al.
Journal of Vacuum Science & Technology A Vacuum Surfaces and Films
Scientific Computing and Data Management
article

“The paper I wish I had written with Giacinto Scoles,” the cherry-picking of data, and other reflections on reproducibility issues

Joshua W. Pinder, Matthew R. Linford, Donald Baer, J. S. Price, Rhone O’Hara
article en

Abstract

While most scientists work ethically, science is dealing with serious issues related to experimental replication, data quality, and literature completeness, which are often addressed under the heading of a reproducibility crisis. For example, as much as 90% of all biomedical research may be irreproducible and up to 30% of it is fraudulent. In surface analysis, 40% of the x-ray photoelectron spectroscopy data analysis (peak fitting) in the scientific literature may be incorrect and another 40% of it is suspect. We present and discuss five aspects of the reproducibility crisis: how our biases and preconceived notions affect what we publish, cherry-picking of data, the value of collaboration, linking related articles including with commentary by artificial intelligence (AI), and data availability and analysis transparency. Perspectives in this article come from surface science, biological sciences, and educational publishing. What and how we select materials for publishing has a significant impact on reproducibility challenges, particularly with the expanding uses of AI.

Journal of Vacuum Science & Technology A Vacuum Surfaces and FilmsVol. 44(3)
Brigham Young University (US), Pearson (United States) (US), Pacific Northwest National Laboratory (US)
Openalex Percentile: Top 19%
Scientific Computing and Data Management
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.