Title Pending 28

The social sciences are facing a credibility crisis driven by two interrelated tendencies: an overreliance on abstract theorizing (“theory fetishism”) and the ritualistic application of Null Hypothesis Significance Testing (NHST), which often lends false authority to inconsequential p-values. Through a satirical ‘Health Communication Criminology’ thought experiment and real-world examples from psychology, nutrition, and criminology, we illustrate how theory fetishism encourages post hoc rationalizations, while NHST, model fit indices, and machine-learning-derived ‘importance scores’ create an illusion of certainty. These practices routinely exaggerate the significance of findings while accounting for minimal variance at the population level. To address these issues, we propose two correctives: (1) integrating effect size and prevalence using population attributable fractions to better assess societal impact; and (2) interpreting the proportion-mediated statistic (Tₚ) as an upper limit—not definitive evidence—of mediation. We further identify common analytical pitfalls, such as comparing coefficients across different models, indiscriminate use of matching and mediation analyses, and conflating interpretability with causality. A path forward requires rigorous causal designs, transparent reporting of uncertainty, and a commitment to epistemic humility—essential steps toward improving replicability and generating evidence that is truly meaningful for policy and real-world outcomes.

Institutions

Publication Details

Journal
Transformative Society
Published
2025-05-03
DOI
https://doi.org/10.63336/transsoc.28
Citations
1
Primary Topic
Advanced Causal Inference Techniques
Type
article
Field-Weighted Citation Impact
2.63
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Title Pending 28

1 citations
Transformative Society
Advanced Causal Inference Techniques
2.63
article

Title Pending 28

article en
1 citations

Abstract

The social sciences are facing a credibility crisis driven by two interrelated tendencies: an overreliance on abstract theorizing (“theory fetishism”) and the ritualistic application of Null Hypothesis Significance Testing (NHST), which often lends false authority to inconsequential p-values. Through a satirical ‘Health Communication Criminology’ thought experiment and real-world examples from psychology, nutrition, and criminology, we illustrate how theory fetishism encourages post hoc rationalizations, while NHST, model fit indices, and machine-learning-derived ‘importance scores’ create an illusion of certainty. These practices routinely exaggerate the significance of findings while accounting for minimal variance at the population level. To address these issues, we propose two correctives: (1) integrating effect size and prevalence using population attributable fractions to better assess societal impact; and (2) interpreting the proportion-mediated statistic (Tₚ) as an upper limit—not definitive evidence—of mediation. We further identify common analytical pitfalls, such as comparing coefficients across different models, indiscriminate use of matching and mediation analyses, and conflating interpretability with causality. A path forward requires rigorous causal designs, transparent reporting of uncertainty, and a commitment to epistemic humility—essential steps toward improving replicability and generating evidence that is truly meaningful for policy and real-world outcomes.

Transformative SocietyVol. 1(2)
Zhongnan University of Economics and Law (CN), University of Macau (MO)
Openalex Percentile: Top 12%
Advanced Causal Inference Techniques
2.63
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Title Pending 28 · Transformative Society (2025) | TGRS Research Map | TGRS