Learning from practice: Expanding the OECD’s impact evaluation criteria based on experiences of subnational climate assemblies in France, Spain and Portugal

Climate Assemblies (CAs) aim to incorporate citizens’ perspectives into public policy. To evaluate their policy impact, researchers often rely on the OECD’s evaluation criteria, which are designed for a broad range of deliberative processes. However, recent CAs developments—particularly at the subnational level—have introduced innovative practices that are not fully captured by these existing frameworks. In response to ongoing academic debates on CAs and its impact measurement, this study draws on practical experiences and discourses to refine and expand the OECD’s policy impact criteria. Based on semi-structured, in-depth interviews with 14 key informants involved in 8 subnational CAs in France, Spain, and Portugal, our aim is to adapt the policy impact criteria by integrating academic debates and empirical insights from subnational contexts. Traditionally, policy impact evaluation has been treated as a separate dimension, disconnected from the design and implementation phases. However, our thematic analysis reveals that a holistic evaluation of the entire CA process is necessary to accurately assess its impact. Thus, we argue that key factors—such as the alignment of mandates with existing public policies, the inclusion and roles of various social actors throughout the process, and internal governance structures—must be considered in future evaluation frameworks. Ultimately, we offer new considerations and adaptations that enhance the assessment of policy impact for subnational CAs. • CA policy impact evaluation is inseparable from its design and implementation phases. • The alignment of CA’s mandates with policy plans has to be evaluated. • Examining how relevant authorities and wider public are included in the CA’s process. • Subnational level particularities have to be addressed in CAs’ evaluation.

Authors

Institutions

Publication Details

Journal
Environmental Science & Policy
Published
2024-12-22
DOI
https://doi.org/10.1016/j.envsci.2024.103978
Citations
1
Primary Topic
Policy Transfer and Learning
Type
article
Field-Weighted Citation Impact
2.23
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Learning from practice: Expanding the OECD’s impact evaluation criteria based on experiences of subnational climate assemblies in France, Spain and Portugal

Emma Lancha-Hernández, Isabel Becerril-Viera
1 citations
Environmental Science & Policy
Policy Transfer and Learning
2.23
article

Learning from practice: Expanding the OECD’s impact evaluation criteria based on experiences of subnational climate assemblies in France, Spain and Portugal

Emma Lancha-Hernández, Isabel Becerril-Viera
article en
1 citations

Abstract

Climate Assemblies (CAs) aim to incorporate citizens’ perspectives into public policy. To evaluate their policy impact, researchers often rely on the OECD’s evaluation criteria, which are designed for a broad range of deliberative processes. However, recent CAs developments—particularly at the subnational level—have introduced innovative practices that are not fully captured by these existing frameworks. In response to ongoing academic debates on CAs and its impact measurement, this study draws on practical experiences and discourses to refine and expand the OECD’s policy impact criteria. Based on semi-structured, in-depth interviews with 14 key informants involved in 8 subnational CAs in France, Spain, and Portugal, our aim is to adapt the policy impact criteria by integrating academic debates and empirical insights from subnational contexts. Traditionally, policy impact evaluation has been treated as a separate dimension, disconnected from the design and implementation phases. However, our thematic analysis reveals that a holistic evaluation of the entire CA process is necessary to accurately assess its impact. Thus, we argue that key factors—such as the alignment of mandates with existing public policies, the inclusion and roles of various social actors throughout the process, and internal governance structures—must be considered in future evaluation frameworks. Ultimately, we offer new considerations and adaptations that enhance the assessment of policy impact for subnational CAs. • CA policy impact evaluation is inseparable from its design and implementation phases. • The alignment of CA’s mandates with policy plans has to be evaluated. • Examining how relevant authorities and wider public are included in the CA’s process. • Subnational level particularities have to be addressed in CAs’ evaluation.

Environmental Science & PolicyVol. 163
Instituto de Estudios Sociales Avanzados (ES)
Climate action
Openalex Percentile: Top 8%
Policy Transfer and Learning
2.23
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Learning from practice: Expanding the OECD’s impact evaluation criteria based on experiences of subnational climate assemblies in France, Spain and Portugal — Emma Lancha-Hernández, Isabel Becerril-Viera · Environmental Science & Policy (2024) | TGRS Research Map | TGRS