<i>P</i> -hacking and Significance Stars

Abstract In mid-2016, all journals of the American Economic Association stopped including significance stars in their regression tables. This policy aimed to reduce the emphasis on statistical significance and shift the focus to the broader economic importance of research findings. This study examines the impact of this change on p-hacking and publication bias. I employ a difference-in-difference design, as well as the battery of tests proposed by Elliott et al. (2022b). I find no statistically significant effect of this policy.

Authors

Institutions

Publication Details

Journal
The Economic Journal
Published
2025-08-13
DOI
https://doi.org/10.1093/ej/ueaf073
Primary Topic
Semantic Web and Ontologies
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

P -hacking and Significance Stars

Costanza Naguib
The Economic Journal
Semantic Web and Ontologies
article

P -hacking and Significance Stars

Costanza Naguib
article en

Abstract

Abstract In mid-2016, all journals of the American Economic Association stopped including significance stars in their regression tables. This policy aimed to reduce the emphasis on statistical significance and shift the focus to the broader economic importance of research findings. This study examines the impact of this change on p-hacking and publication bias. I employ a difference-in-difference design, as well as the battery of tests proposed by Elliott et al. (2022b). I find no statistically significant effect of this policy.

The Economic Journal
University of Bern (CH)
Openalex Percentile: Top 88%
Semantic Web and Ontologies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

<i>P</i> -hacking and Significance Stars — Costanza Naguib · The Economic Journal (2025) | TGRS Research Map | TGRS