P-hacking and Significance Stars

In mid-2016, all journals of the American Economic Association stopped including significance stars in their regression tables. This policy aimed to reduce the emphasis on statistical significance and shift the focus to the broader economic importance of research findings. This study examines the impact of this change on p-hacking and publication bias. I employ a difference-in-difference design, as well as the battery of tests proposed by Elliott et al. (2022b). I find no statistically significant effect of this policy.

Authors

Publication Details

Journal
Open Access CRIS of the University of Bern
Published
2025-08-27
DOI
https://doi.org/10.48620/93947
Primary Topic
scientometrics and bibliometrics research
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

P-hacking and Significance Stars

Costanza Naguib
Open Access CRIS of the University of Bern
scientometrics and bibliometrics research
article

P-hacking and Significance Stars

Costanza Naguib
article en

Abstract

In mid-2016, all journals of the American Economic Association stopped including significance stars in their regression tables. This policy aimed to reduce the emphasis on statistical significance and shift the focus to the broader economic importance of research findings. This study examines the impact of this change on p-hacking and publication bias. I employ a difference-in-difference design, as well as the battery of tests proposed by Elliott et al. (2022b). I find no statistically significant effect of this policy.

Open Access CRIS of the University of Bern
Openalex Percentile: Top 25%
scientometrics and bibliometrics research
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

P-hacking and Significance Stars — Costanza Naguib · Open Access CRIS of the University of Bern (2025) | TGRS Research Map | TGRS