The file drawer problem in social science survey experiments
The file drawer problem-often operationalized in terms of statistically significant results being published and statistically insignificant not being published-is widely documented in the social sciences. We extend Franco's et al. [<i>Science</i> <b>345</b>, 1502-1505(2014)] seminal study of the file drawer problem in survey experiments submitted to the Time-sharing Experiments for the Social Sciences (TESS) data collection program. We examine projects begun after Franco et al. The updated period coincides with the contemporary open science movement. We find evidence of the problem, stemming from scholars opting to not write up insignificant results. However, that tendency is substantially smaller than it was in the prior decade. This suggests increased recognition of the importance of null results, even if the problem remains in the domain of survey experiments.
Authors
- James Druckman (ORCID: https://orcid.org/0000-0002-1249-6790)
- Philip Moniz
- Jeremy Freese (ORCID: https://orcid.org/0000-0002-9451-6432)
Institutions
- Northeastern University (US)
- University of Rochester (US)
- Stanford University (US)
Publication Details
- Journal
- Proceedings of the National Academy of Sciences
- Published
- 2025-03-19
- DOI
- https://doi.org/10.1073/pnas.2426937122
- Citations
- 4
- Primary Topic
- Survey Methodology and Nonresponse
- Type
- article
- Field-Weighted Citation Impact
- 16.81
Funders
- National Science Foundation