<i>P-</i> curving the Evidence: <i>P-</i> values Published in <i>Human Factors</i> (2017–2023)
Publication bias and questionable research practices can inflate the perceived credibility of reported scientific findings and lead to low replicability. This preregistered study aimed to estimate the evidentiary value of empirical findings published in the journal Human Factors (2017–2023) using two meta-analytic methods: p- curve analysis to examine the distribution of significant p -values and Bayesian mixture modeling of p- value distributions to gauge the degree of contamination from the null hypothesis. Empirical findings from 62 articles were included in the analyses. P- curve results indicated evidential value, ruling out high levels of selective reporting as an explanation for significant results. Mixture modeling estimated a 25% contamination rate by the null hypothesis among significant p- values. Results document the quality of empirical evidence reported in Human Factors .
Authors
- Jason S. McCarley (ORCID: https://orcid.org/0000-0002-8824-7491)
- Jeremy Johnson (ORCID: https://orcid.org/0000-0002-2785-9777)
- Briana Hoxha
- Andrew Do
- Fernando Munoz Gomez Andrade (ORCID: https://orcid.org/0009-0002-4414-3356)
- Alina Hyk
- Jannah R. Moussaoui (ORCID: https://orcid.org/0009-0007-1933-1335)
- Macy Smart-Zimmerman
- Caitlin Gallik
- Kali Kuhn
- Sophia Fischer
- Boone Gutierrez
Institutions
- Oregon State University (US)
- Drexel University (US)
Publication Details
- Journal
- Proceedings of the Human Factors and Ergonomics Society Annual Meeting
- Published
- 2024-08-29
- DOI
- https://doi.org/10.1177/10711813241275505
- Primary Topic
- Meta-analysis and systematic reviews
- Type
- article
- Field-Weighted Citation Impact
- 0.00