Can I trust this paper?

After a decade of data falsification scandals and replication failures in psychology and related empirical disciplines, there are urgent calls for open science and structural reform in the publishing industry. In the meantime, however, researchers need to learn how to recognize tell-tale signs of methodological and conceptual shortcomings that make a published claim suspect. I review key problems and ways to detect them, including data fabrication or falsification, low precision of estimates, incorrectly performed or interpreted statistical procedures, biased meta-analyses, and over-generalization of results. The main takeaway is to verify that the methodology is robust and to distinguish between what the actual results are and what the authors claim these results mean when citing empirical work.

Publication Details

Journal
Open Science Framework
Published
2025-01-01
DOI
https://doi.org/10.17605/osf.io/n7r2y
Primary Topic
Algal biology and biofuel production
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Can I trust this paper?

Open Science Framework
Algal biology and biofuel production
article

Can I trust this paper?

article en

Abstract

After a decade of data falsification scandals and replication failures in psychology and related empirical disciplines, there are urgent calls for open science and structural reform in the publishing industry. In the meantime, however, researchers need to learn how to recognize tell-tale signs of methodological and conceptual shortcomings that make a published claim suspect. I review key problems and ways to detect them, including data fabrication or falsification, low precision of estimates, incorrectly performed or interpreted statistical procedures, biased meta-analyses, and over-generalization of results. The main takeaway is to verify that the methodology is robust and to distinguish between what the actual results are and what the authors claim these results mean when citing empirical work.

Open Science Framework
Peace, Justice and strong institutions
Openalex Percentile: Top 65%
Algal biology and biofuel production
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Can I trust this paper? · Open Science Framework (2025) | TGRS Research Map | TGRS