Rethinking Realist Evaluation of Complex Social Interventions: From Causal Snapshots to Adaptive Causal Learning

Realist evaluation using Context-Mechanism-Outcome (CMO) configurations offers a compelling account of generative causation in complex interventions. However, the theories of change within which CMO configurations are embedded often function as epistemic artifacts that fix causal claims and constrain adaptive learning. This gap is structurally reinforced by commissioning frameworks, accountability requirements, and reporting structures that encourage static representations of change. Drawing on a program-level theory of change developed for a multi-site randomized evaluation of community-based violence intervention across five UK cities, we show how complexity-aware realist evaluation can address these shortcomings. Tracing targeted police enforcement across delivery sites, we identify three dynamics—contextual recursion, temporal non-linearity, and configurational causation—that required progressive revision of the causal model. We distill this into six transferable principles that retain realist generative explanation while treating causal understanding as provisional and subject to iterative refinement. Although developed within realist evaluation, these principles apply more broadly to theory-based evaluation.

Authors

Institutions

Publication Details

Journal
American Journal of Evaluation
Published
2026-11-01
DOI
https://doi.org/10.1177/10982140261502408
Primary Topic
Evaluation and Performance Assessment
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Rethinking Realist Evaluation of Complex Social Interventions: From Causal Snapshots to Adaptive Causal Learning

William Graham, Iain R. Brennan, Alex Sutherland, Paul McFarlane et al.
American Journal of Evaluation
Evaluation and Performance Assessment
article

Rethinking Realist Evaluation of Complex Social Interventions: From Causal Snapshots to Adaptive Causal Learning

William Graham, Iain R. Brennan, Alex Sutherland, Paul McFarlane, Tia McPherson
article en

Abstract

Realist evaluation using Context-Mechanism-Outcome (CMO) configurations offers a compelling account of generative causation in complex interventions. However, the theories of change within which CMO configurations are embedded often function as epistemic artifacts that fix causal claims and constrain adaptive learning. This gap is structurally reinforced by commissioning frameworks, accountability requirements, and reporting structures that encourage static representations of change. Drawing on a program-level theory of change developed for a multi-site randomized evaluation of community-based violence intervention across five UK cities, we show how complexity-aware realist evaluation can address these shortcomings. Tracing targeted police enforcement across delivery sites, we identify three dynamics—contextual recursion, temporal non-linearity, and configurational causation—that required progressive revision of the causal model. We distill this into six transferable principles that retain realist generative explanation while treating causal understanding as provisional and subject to iterative refinement. Although developed within realist evaluation, these principles apply more broadly to theory-based evaluation.

American Journal of Evaluation
University of Hull (GB), University of Oxford (GB), University College London (GB), Abertay University (GB)
Openalex Percentile: Top 9%
Evaluation and Performance Assessment
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon