Integrating systems and implementation science in modeling and evaluating complex health interventions: methodological reflections from service delivery redesign in Kakamega, Kenya

Intervention evaluation is critical for determining the value of health interventions; however, real-world implementation frequently falls short of achieving anticipated large-scale impacts. This evidence-to-practice gap often arises from challenges in capturing the complexity inherent in intervention implementation. This complexity may stem from the intervention itself, the dynamic and interrelated processes of dissemination, implementation, and sustainment, or the constraints of real-world settings characterized by interconnected systems. Integrating implementation science, which employs theories, models, and frameworks to understand the adoption and integration of evidence-based interventions, with systems science, which provides tools to model and analyze complex systems, offers a promising pathway for addressing these challenges. However, practical guidance on combining these approaches to evaluate dynamic interactions between interventions and implementation contexts, while simultaneously capturing system-level learnings, remains limited. In this methodological musing, we reflect on our experience integrating systems and implementation science to develop a conceptual and quantitative model for scenario evaluation of a maternal health service delivery redesign initiative in Kakamega, Kenya. We use four research objectives as a touchstone for organizing our reflections, explicated by three steps of an evaluation process: (i) developing a qualitative systems model using implementation frameworks and causal loop diagrams; (ii) constructing and parameterizing a quantitative computational model; and (iii) conducting scenario analyses to explore "what-if" strategies and inform adaptive planning. These reflections highlight the potential strengths of an integrated approach and offer practical considerations for researchers and practitioners evaluating complex health interventions through quantitative modeling and scenario development.

Authors

Institutions

Publication Details

Journal
Health Policy and Planning
Published
2025-11-25
DOI
https://doi.org/10.1093/heapol/czaf099
Primary Topic
Health Policy Implementation Science
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Integrating systems and implementation science in modeling and evaluating complex health interventions: methodological reflections from service delivery redesign in Kakamega, Kenya

Meibin Chen, Tingting Ji, Takeru Igusa, Olakunle Alonge
Health Policy and Planning
Health Policy Implementation Science
article

Integrating systems and implementation science in modeling and evaluating complex health interventions: methodological reflections from service delivery redesign in Kakamega, Kenya

Meibin Chen, Tingting Ji, Takeru Igusa, Olakunle Alonge
article en

Abstract

Intervention evaluation is critical for determining the value of health interventions; however, real-world implementation frequently falls short of achieving anticipated large-scale impacts. This evidence-to-practice gap often arises from challenges in capturing the complexity inherent in intervention implementation. This complexity may stem from the intervention itself, the dynamic and interrelated processes of dissemination, implementation, and sustainment, or the constraints of real-world settings characterized by interconnected systems. Integrating implementation science, which employs theories, models, and frameworks to understand the adoption and integration of evidence-based interventions, with systems science, which provides tools to model and analyze complex systems, offers a promising pathway for addressing these challenges. However, practical guidance on combining these approaches to evaluate dynamic interactions between interventions and implementation contexts, while simultaneously capturing system-level learnings, remains limited. In this methodological musing, we reflect on our experience integrating systems and implementation science to develop a conceptual and quantitative model for scenario evaluation of a maternal health service delivery redesign initiative in Kakamega, Kenya. We use four research objectives as a touchstone for organizing our reflections, explicated by three steps of an evaluation process: (i) developing a qualitative systems model using implementation frameworks and causal loop diagrams; (ii) constructing and parameterizing a quantitative computational model; and (iii) conducting scenario analyses to explore "what-if" strategies and inform adaptive planning. These reflections highlight the potential strengths of an integrated approach and offer practical considerations for researchers and practitioners evaluating complex health interventions through quantitative modeling and scenario development.

Health Policy and PlanningVol. 41(2)
Johns Hopkins University (US), Johns Hopkins Medicine (US), University of Alabama at Birmingham (US), University of Baltimore (US)
Bill and Melinda Gates Foundation, Johns Hopkins University
Openalex Percentile: Top 46%
Health Policy Implementation Science
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.