How large must an associational mean difference be to support a causal effect?

An observational study might support a causal claim if the association found cannot be explained by bias due to unconsidered confounders. This bias depends on how strongly the common predisposition, a summary of unconsidered confounders, is related to the factor and the outcome. For a positive effect to be supported, the product of these two relations must be smaller than the left boundary of the confidence interval for, e.g., a standardised mean difference ( d ). We suggest means to derive heuristics for how large this product must be to serve as a confirmatory threshold. We also provide non-technical, visual means to express researchers’ assumptions on the two relations to assess whether a finding on d is explainable by omitted confounders. The ViSe tool, available as an R package and Shiny application, allows users to choose between various effect sizes and apply it to their own data or published summary results.

Authors

Institutions

Publication Details

Journal
Methodology
Published
2024-12-20
DOI
https://doi.org/10.5964/meth.14579
Citations
1
Primary Topic
Advanced Causal Inference Techniques
Type
article
Field-Weighted Citation Impact
0.71
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

How large must an associational mean difference be to support a causal effect?

Erin Michelle Buchanan, Ekaterina Pronizius, Michael Höfler
1 citations
Methodology
Advanced Causal Inference Techniques
0.71
article

How large must an associational mean difference be to support a causal effect?

Erin Michelle Buchanan, Ekaterina Pronizius, Michael Höfler
article en
1 citations

Abstract

An observational study might support a causal claim if the association found cannot be explained by bias due to unconsidered confounders. This bias depends on how strongly the common predisposition, a summary of unconsidered confounders, is related to the factor and the outcome. For a positive effect to be supported, the product of these two relations must be smaller than the left boundary of the confidence interval for, e.g., a standardised mean difference ( d ). We suggest means to derive heuristics for how large this product must be to serve as a confirmatory threshold. We also provide non-technical, visual means to express researchers’ assumptions on the two relations to assess whether a finding on d is explainable by omitted confounders. The ViSe tool, available as an R package and Shiny application, allows users to choose between various effect sizes and apply it to their own data or published summary results.

MethodologyVol. 20(4)
Harrisburg University of Science and Technology (US), Technische Universität Dresden (DE), UCLouvain (BE)
Openalex Percentile: Top 23%
Advanced Causal Inference Techniques
0.71
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.