Preregistration in Evaluation: Lessons About Preregistration of Outcomes and Analytic Protocols From a National Job Training Program Evaluation
ABSTRACT This article explores the application of open science practices, focusing on the challenges, barriers, and lessons learned from preregistering outcomes and analytic protocols in impact evaluation. Using the Health Profession Opportunity Grants (HPOG) Program Impact Study as a case study, we illustrate the balance between pre‐specifying research plans and maintaining flexibility to adapt to unexpected findings. We discuss how preregistration can enhance transparency, credibility, and the overall quality of evidence, as well as practical considerations for future evaluations. Our insights aim to guide evaluators in applying open science principles to improve the rigor and integrity of impact evaluations.
Authors
- Laura R. Peck (ORCID: https://orcid.org/0000-0002-8516-9950)
- Daniel Litwok (ORCID: https://orcid.org/0000-0003-0405-2521)
Institutions
- MEF Associates (US)
Publication Details
- Journal
- New Directions for Evaluation
- Published
- 2024-12-01
- DOI
- https://doi.org/10.1002/ev.20623
- Citations
- 1
- Primary Topic
- Evaluation and Performance Assessment
- Type
- article
- Field-Weighted Citation Impact
- 0.49