Evaluation as a source of unhappiness in academia—unpacking the boundaries of responsible research assessment

Abstract The study conceptualizes research evaluation as an affective practice and shows that researchers’ experiences of unhappiness associated with evaluations broadly align with the main themes of Responsible Research Assessment (RRA). However, RRA cannot fully address the emotional tensions embedded in evaluation processes. The findings indicate that this misalignment arises from the inherently subjective nature of research assessments. The study expands the understanding of RRA’s boundaries by illustrating how the procedural level of evaluation, particularly its reliance on peer review, alongside organizational constraints, contributes to this complexity. The study, set in the Finnish context draws on survey data to explore researchers’ preferences for evaluation practices and the types of skills and expertise they believe should be recognized and rewarded. To further examine the emotional dimensions of these experiences, the study draws on affect theory and focuses on the survey’s open-ended questions, specifically responses from researchers in the Social Sciences and Humanities (N = 181). From this perspective, research evaluation emerges not merely as a technical task, but as an affective practice shaping how researchers experience academic work. To promote sustainable research culture, it is essential to recognize evaluation’s dual role in researchers’ experiences of unhappiness, encompassing both its fundamental ranking and resource allocation functions and its procedural level, where RRA offers potential for improvements. If development work on RRA fails to acknowledge evaluation’s inherent subjective nature, it risks disconnecting researchers’ experiences from policy ideals. Without confronting these limitations, reform efforts may drift towards an idealized vision of evaluation that ultimately becomes self-perpetuating.

Authors

Institutions

Publication Details

Journal
Research Evaluation
Published
2024-12-27
DOI
https://doi.org/10.1093/reseval/rvaf034
Citations
2
Primary Topic
Doctoral Education Challenges and Solutions
Type
article
Field-Weighted Citation Impact
1.70
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Evaluation as a source of unhappiness in academia—unpacking the boundaries of responsible research assessment

Laura Himanen, Reetta Muhonen
2 citations
Research Evaluation
Doctoral Education Challenges and Solutions
1.70
article

Evaluation as a source of unhappiness in academia—unpacking the boundaries of responsible research assessment

Laura Himanen, Reetta Muhonen
article en
2 citations

Abstract

Abstract The study conceptualizes research evaluation as an affective practice and shows that researchers’ experiences of unhappiness associated with evaluations broadly align with the main themes of Responsible Research Assessment (RRA). However, RRA cannot fully address the emotional tensions embedded in evaluation processes. The findings indicate that this misalignment arises from the inherently subjective nature of research assessments. The study expands the understanding of RRA’s boundaries by illustrating how the procedural level of evaluation, particularly its reliance on peer review, alongside organizational constraints, contributes to this complexity. The study, set in the Finnish context draws on survey data to explore researchers’ preferences for evaluation practices and the types of skills and expertise they believe should be recognized and rewarded. To further examine the emotional dimensions of these experiences, the study draws on affect theory and focuses on the survey’s open-ended questions, specifically responses from researchers in the Social Sciences and Humanities (N = 181). From this perspective, research evaluation emerges not merely as a technical task, but as an affective practice shaping how researchers experience academic work. To promote sustainable research culture, it is essential to recognize evaluation’s dual role in researchers’ experiences of unhappiness, encompassing both its fundamental ranking and resource allocation functions and its procedural level, where RRA offers potential for improvements. If development work on RRA fails to acknowledge evaluation’s inherent subjective nature, it risks disconnecting researchers’ experiences from policy ideals. Without confronting these limitations, reform efforts may drift towards an idealized vision of evaluation that ultimately becomes self-perpetuating.

Research EvaluationVol. 34
Federation of Finnish Learned Societies (FI), Tampere University (FI), CSC - IT Center for Science (Finland) (FI)
Openalex Percentile: Top 12%
Doctoral Education Challenges and Solutions
1.70
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.