Failures in impact evaluation

Abstract While many definitions of research impact exist, what most share is a belief in the responsibility of research, and researchers, to support positive change in wider society. But this article outlines the growing body of literature on both evaluation and impact that raises concerns with this approach. On the one hand an assumption of positive change may not only ignore the potential for negative impacts but also discourage research which is critical, exploratory or risky. The authors of this article further argue it may encourage narratives of success that mask stories of failure. This article discusses The FailSpace project, research funded by the Arts and Humanities Research Council (AHRC), which examined how evaluation might better identify, acknowledge, and learn from failures This article embodies the principles of FailSpace by reflecting on the failures, rather than successes, of this research project, regarding its intended impact based on findings of an autoethnographic evaluation of FailSpace’s impact. In so doing the authors consider what might be gained from the inclusion of failure metrics in impact evaluations.

Authors

Institutions

Publication Details

Journal
Research Evaluation
Published
2024-12-27
DOI
https://doi.org/10.1093/reseval/rvaf033
Citations
1
Primary Topic
Evaluation and Performance Assessment
Type
article
Field-Weighted Citation Impact
0.49

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Failures in impact evaluation

David Stevenson, Leila Jancovich, Ceri Pitches
1 citations
Research Evaluation
Evaluation and Performance Assessment
0.49
article

Failures in impact evaluation

David Stevenson, Leila Jancovich, Ceri Pitches
article en
1 citations

Abstract

Abstract While many definitions of research impact exist, what most share is a belief in the responsibility of research, and researchers, to support positive change in wider society. But this article outlines the growing body of literature on both evaluation and impact that raises concerns with this approach. On the one hand an assumption of positive change may not only ignore the potential for negative impacts but also discourage research which is critical, exploratory or risky. The authors of this article further argue it may encourage narratives of success that mask stories of failure. This article discusses The FailSpace project, research funded by the Arts and Humanities Research Council (AHRC), which examined how evaluation might better identify, acknowledge, and learn from failures This article embodies the principles of FailSpace by reflecting on the failures, rather than successes, of this research project, regarding its intended impact based on findings of an autoethnographic evaluation of FailSpace’s impact. In so doing the authors consider what might be gained from the inclusion of failure metrics in impact evaluations.

Research EvaluationVol. 34
University of Leeds (GB), Queen Margaret University (GB)
Arts and Humanities Research Council
Openalex Percentile: Top 26%
Evaluation and Performance Assessment
0.49
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Failures in impact evaluation — David Stevenson, Leila Jancovich, et al. · Research Evaluation (2024) | TGRS Research Map | TGRS