<i>P-</i> curving the Evidence: <i>P-</i> values Published in <i>Human Factors</i> (2017–2023)

Publication bias and questionable research practices can inflate the perceived credibility of reported scientific findings and lead to low replicability. This preregistered study aimed to estimate the evidentiary value of empirical findings published in the journal Human Factors (2017–2023) using two meta-analytic methods: p- curve analysis to examine the distribution of significant p -values and Bayesian mixture modeling of p- value distributions to gauge the degree of contamination from the null hypothesis. Empirical findings from 62 articles were included in the analyses. P- curve results indicated evidential value, ruling out high levels of selective reporting as an explanation for significant results. Mixture modeling estimated a 25% contamination rate by the null hypothesis among significant p- values. Results document the quality of empirical evidence reported in Human Factors .

Authors

Institutions

Publication Details

Journal
Proceedings of the Human Factors and Ergonomics Society Annual Meeting
Published
2024-08-29
DOI
https://doi.org/10.1177/10711813241275505
Primary Topic
Meta-analysis and systematic reviews
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

P- curving the Evidence: P- values Published in Human Factors (2017–2023)

Jason S. McCarley, Jeremy Johnson, Briana Hoxha, Andrew Do et al.
Proceedings of the Human Factors and Ergonomics Society Annual Meeting
Meta-analysis and systematic reviews
article

P- curving the Evidence: P- values Published in Human Factors (2017–2023)

Jason S. McCarley, Jeremy Johnson, Briana Hoxha, Andrew Do, Fernando Munoz Gomez Andrade, Alina Hyk, Jannah R. Moussaoui, Macy Smart-Zimmerman, Caitlin Gallik, Kali Kuhn, Sophia Fischer, Boone Gutierrez
article en

Abstract

Publication bias and questionable research practices can inflate the perceived credibility of reported scientific findings and lead to low replicability. This preregistered study aimed to estimate the evidentiary value of empirical findings published in the journal Human Factors (2017–2023) using two meta-analytic methods: p- curve analysis to examine the distribution of significant p -values and Bayesian mixture modeling of p- value distributions to gauge the degree of contamination from the null hypothesis. Empirical findings from 62 articles were included in the analyses. P- curve results indicated evidential value, ruling out high levels of selective reporting as an explanation for significant results. Mixture modeling estimated a 25% contamination rate by the null hypothesis among significant p- values. Results document the quality of empirical evidence reported in Human Factors .

Proceedings of the Human Factors and Ergonomics Society Annual MeetingVol. 68(1)
Oregon State University (US), Drexel University (US)
Openalex Percentile: Top 86%
Meta-analysis and systematic reviews
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

<i>P-</i> curving the Evidence: <i>P-</i> values Published in <i>Human Factors</i> (2017–2023) — Jason S. McCarley, Jeremy Johnson, et al. · Proceedings of the Human Factors and Ergonomics Society Annual Meeting (2024) | TGRS Research Map | TGRS