Ethical oversight in impact evaluations: External advisory committees to assess programming risks

Social scientists not only conduct impact evaluations but also participate in the design and implementation of the programs being evaluated. While Institutional Review Boards (IRBs) oversee research activities, they do not assess risks posed by the interventions themselves. We propose establishing External Advisory Committees (EACs) to provide independent, expert oversight of programming risks. EACs complement IRBs by focusing on potential harms to participants and communities, offering dynamic risk assessments, and advising on program adaptations or termination. By providing impartial expertise, EACs help address potential conflicts of interest that may arise when researchers and implementers are invested in a program's continuation. We illustrate the value of EACs through our experience implementing a cross-border labor migration program in Niger. Our EAC provided crucial guidance on scaling up the intervention after a pilot study and adapting the program following an unexpected military coup. While EACs introduce additional costs and may limit researcher autonomy, they generate accountability and are particularly valuable for novel and politically sensitive interventions in fragile environments.

Authors

Institutions

Publication Details

Journal
Proceedings of the National Academy of Sciences
Published
2025-11-14
DOI
https://doi.org/10.1073/pnas.2509773122
Primary Topic
Evaluation and Performance Assessment
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Ethical oversight in impact evaluations: External advisory committees to assess programming risks

Jeremy M. Weinstein, Darin Christensen, Allison N. Grossman, Guy Grossman et al.
Proceedings of the National Academy of Sciences
Evaluation and Performance Assessment
article

Ethical oversight in impact evaluations: External advisory committees to assess programming risks

Jeremy M. Weinstein, Darin Christensen, Allison N. Grossman, Guy Grossman, Jessica Wolff, Jon Kurtz
article en

Abstract

Social scientists not only conduct impact evaluations but also participate in the design and implementation of the programs being evaluated. While Institutional Review Boards (IRBs) oversee research activities, they do not assess risks posed by the interventions themselves. We propose establishing External Advisory Committees (EACs) to provide independent, expert oversight of programming risks. EACs complement IRBs by focusing on potential harms to participants and communities, offering dynamic risk assessments, and advising on program adaptations or termination. By providing impartial expertise, EACs help address potential conflicts of interest that may arise when researchers and implementers are invested in a program's continuation. We illustrate the value of EACs through our experience implementing a cross-border labor migration program in Niger. Our EAC provided crucial guidance on scaling up the intervention after a pilot study and adapting the program following an unexpected military coup. While EACs introduce additional costs and may limit researcher autonomy, they generate accountability and are particularly valuable for novel and politically sensitive interventions in fragile environments.

Proceedings of the National Academy of SciencesVol. 122(47)
Tulane University (US), Mercy Corps (US), Migration Policy Institute (US), Harvard University (US), University of California, Los Angeles (US), John F. Kennedy University (US), Harvard University Press (US), University of California System (US), California University of Pennsylvania (US), Institute of Public Affairs (PL), Institute for Learning and Development (US), University of Pennsylvania (US), Stanford University (US)
Yale University
Openalex Percentile: Top 60%
Evaluation and Performance Assessment
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.