The file drawer problem in social science survey experiments

The file drawer problem-often operationalized in terms of statistically significant results being published and statistically insignificant not being published-is widely documented in the social sciences. We extend Franco's et al. [<i>Science</i> <b>345</b>, 1502-1505(2014)] seminal study of the file drawer problem in survey experiments submitted to the Time-sharing Experiments for the Social Sciences (TESS) data collection program. We examine projects begun after Franco et al. The updated period coincides with the contemporary open science movement. We find evidence of the problem, stemming from scholars opting to not write up insignificant results. However, that tendency is substantially smaller than it was in the prior decade. This suggests increased recognition of the importance of null results, even if the problem remains in the domain of survey experiments.

Authors

Institutions

Publication Details

Journal
Proceedings of the National Academy of Sciences
Published
2025-03-19
DOI
https://doi.org/10.1073/pnas.2426937122
Citations
4
Primary Topic
Survey Methodology and Nonresponse
Type
article
Field-Weighted Citation Impact
16.81

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

The file drawer problem in social science survey experiments

James Druckman, Philip Moniz, Jeremy Freese
4 citations
Proceedings of the National Academy of Sciences
Survey Methodology and Nonresponse
16.81
article

The file drawer problem in social science survey experiments

James Druckman, Philip Moniz, Jeremy Freese
article en
4 citations

Abstract

The file drawer problem-often operationalized in terms of statistically significant results being published and statistically insignificant not being published-is widely documented in the social sciences. We extend Franco's et al. [<i>Science</i> <b>345</b>, 1502-1505(2014)] seminal study of the file drawer problem in survey experiments submitted to the Time-sharing Experiments for the Social Sciences (TESS) data collection program. We examine projects begun after Franco et al. The updated period coincides with the contemporary open science movement. We find evidence of the problem, stemming from scholars opting to not write up insignificant results. However, that tendency is substantially smaller than it was in the prior decade. This suggests increased recognition of the importance of null results, even if the problem remains in the domain of survey experiments.

Proceedings of the National Academy of SciencesVol. 122(12)
Northeastern University (US), University of Rochester (US), Stanford University (US)
National Science Foundation
Openalex Percentile: Top 1%
Survey Methodology and Nonresponse
16.81
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.