Evaluating in times of paradigmatic change: some reflections on how to conduct ex-post evaluations amidst the transformative turn in research and innovation policy

Abstract The transformative turn in research and innovation (R&I) policy calls for new approaches to monitoring and evaluation, yet most evaluands are still rooted in previous policy paradigms. For evaluators tasked with conducting ex-post evaluations, this situation creates multiple challenges that have received little attention to date. In this ‘voice from the field’, I argue that times of paradigmatic change require an increased awareness about discursive politics, heightened expectations, uncertainties, and the differences between the old and the new in evaluations. Based on recent experiences from an ex-post evaluation of the R&I programme City of Tomorrow, I provide some suggestions for coping with these challenges.

Authors

Institutions

Publication Details

Journal
Research Evaluation
Published
2024-12-26
DOI
https://doi.org/10.1093/reseval/rvae064
Primary Topic
Evaluation and Performance Assessment
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Evaluating in times of paradigmatic change: some reflections on how to conduct ex-post evaluations amidst the transformative turn in research and innovation policy

Harald Wieser
1 links
Research Evaluation
Evaluation and Performance Assessment
article

Evaluating in times of paradigmatic change: some reflections on how to conduct ex-post evaluations amidst the transformative turn in research and innovation policy

Harald Wieser
article en

Abstract

Abstract The transformative turn in research and innovation (R&I) policy calls for new approaches to monitoring and evaluation, yet most evaluands are still rooted in previous policy paradigms. For evaluators tasked with conducting ex-post evaluations, this situation creates multiple challenges that have received little attention to date. In this ‘voice from the field’, I argue that times of paradigmatic change require an increased awareness about discursive politics, heightened expectations, uncertainties, and the differences between the old and the new in evaluations. Based on recent experiences from an ex-post evaluation of the R&I programme City of Tomorrow, I provide some suggestions for coping with these challenges.

Research EvaluationVol. 34
Austrian Institute for SME Research (AT)
Industry, innovation and infrastructure
Openalex Percentile: Top 70%
Evaluation and Performance Assessment
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Evaluating in times of paradigmatic change: some reflections on how to conduct ex-post evaluations amidst the transformative turn in research and innovation policy — Harald Wieser · Research Evaluation (2024) | TGRS Research Map | TGRS