A quantitative approach to evidence triangulation: development of a framework to address rigour and relevance

Triangulation is an approach to strengthen causal inference by integrating evidence from multiple sources. Most studies using triangulation have qualitatively examined whether different studies agree upon the presence of a causal effect, rather than estimated the effect by quantitatively integrating results. Here, we develop a framework for quantitative triangulation. We first address how to relate study-specific research questions to an overall target causal question (relevance) and then assess the directions and magnitudes of bias in each study (rigour), before combining the results using meta-analysis adjusted for the biases. We illustrate our framework by triangulating evidence from randomized controlled trials (RCTs), Mendelian randomization (MR) and conventional multivariable regression (MVR) to estimate the effect of beta-carotene on coronary heart disease (CHD) and cardiovascular disease (CVD). Three RCTs and one MR study showed little evidence of a causal relationship between beta-carotene and CHD (risk ratio (RR) = 1.00 with 95% CI = 0.98 to 1.01 and RR = 1.02 with 95% CI = 0.98 to 1.07, respectively). Seven MVR studies indicated that high intake of beta-carotene reduces CHD risk (RR = 0.83 with 95% CI = 0.76 to 0.91). After applying our framework, the three study designs agreed that there is no strong evidence against the null hypothesis that beta-carotene intake does not affect risk of CHD (RR = 0.99 with 95% CI = 0.82 to 1.21). Findings were similar for CVD. Our framework shows how to address rigour and relevance quantitatively when triangulating evidence from different study designs. We highlight the importance of explicitly defining the target and study-specific research questions.

Authors

Institutions

Publication Details

Journal
European Journal of Epidemiology
Published
2026-11-16
DOI
https://doi.org/10.1007/s10654-026-01484-1
Citations
10
Primary Topic
Meta-analysis and systematic reviews
Type
article
Field-Weighted Citation Impact
10.73

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

A quantitative approach to evidence triangulation: development of a framework to address rigour and relevance

Ana Gonçalves Soares, Kate M. Tilling, Chin Yang Shapland, Julian P. T. Higgins et al.
10 citations
European Journal of Epidemiology
Meta-analysis and systematic reviews
10.73
article

A quantitative approach to evidence triangulation: development of a framework to address rigour and relevance

Ana Gonçalves Soares, Kate M. Tilling, Chin Yang Shapland, Julian P. T. Higgins, D.A. Lawlor, Luke Aidan McGuinness, Maria Carolina Borges, Hemani, Joshua A. Bell, George Davey Smith
article en
10 citations

Abstract

Triangulation is an approach to strengthen causal inference by integrating evidence from multiple sources. Most studies using triangulation have qualitatively examined whether different studies agree upon the presence of a causal effect, rather than estimated the effect by quantitatively integrating results. Here, we develop a framework for quantitative triangulation. We first address how to relate study-specific research questions to an overall target causal question (relevance) and then assess the directions and magnitudes of bias in each study (rigour), before combining the results using meta-analysis adjusted for the biases. We illustrate our framework by triangulating evidence from randomized controlled trials (RCTs), Mendelian randomization (MR) and conventional multivariable regression (MVR) to estimate the effect of beta-carotene on coronary heart disease (CHD) and cardiovascular disease (CVD). Three RCTs and one MR study showed little evidence of a causal relationship between beta-carotene and CHD (risk ratio (RR) = 1.00 with 95% CI = 0.98 to 1.01 and RR = 1.02 with 95% CI = 0.98 to 1.07, respectively). Seven MVR studies indicated that high intake of beta-carotene reduces CHD risk (RR = 0.83 with 95% CI = 0.76 to 0.91). After applying our framework, the three study designs agreed that there is no strong evidence against the null hypothesis that beta-carotene intake does not affect risk of CHD (RR = 0.99 with 95% CI = 0.82 to 1.21). Findings were similar for CVD. Our framework shows how to address rigour and relevance quantitatively when triangulating evidence from different study designs. We highlight the importance of explicitly defining the target and study-specific research questions.

European Journal of Epidemiology
National Institute for Health and Care Research (GB), University of Bristol (GB), NIHR Bristol Biomedical Research Centre (GB), Novo Nordisk (United Kingdom) (GB), MRC Integrative Epidemiology Unit (GB), University Hospitals Bristol and Weston NHS Foundation Trust (GB)
National Institute for Health and Care Research, British Heart Foundation, Medical Research Council, National Institute for Health Research Applied Research Collaboration West, HORIZON EUROPE European Innovation Ecosystems
Good health and well-being
Openalex Percentile: Top 2%
Meta-analysis and systematic reviews
10.73
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon