A typology of peer-reviewers: role, characteristics, and egoistic and altruistic perspectives

Abstract There is a growing amount of research on peer reviewing, not only to obtain a better understanding of it as a key pillar of contemporary science but also because the peer review system is increasingly perceived to be in a state of crisis. Based on a sample of researchers in a variety of scientific fields and geographical locations, this study contributes to a better understanding of who engages in peer reviewing activities. It uses three measures of peer reviewing activity (i.e. number of peer reviews, length of the referee report, and review-to-publication ratio) to create a typology of peer review engagement, and identifies three disproportionally sized clusters of peer review engagement: selfish reviewers (accounting for almost two-thirds of the sample), diligent referees (∼30%), and prolific reviewers (<4%). This typology also permits the identification of a specialization of peer reviewing based on the two main purposes of peer reviewing. Specifically, diligent referees focus on development and improvement, and prolific reviewers focus on gatekeeping and quality control. Demographic (age, gender), professional (academic inbreeding), organizational (resources), and dimensions of the strategic research agendas of researchers characterize all three of the clusters, often in diverse manners. The findings underline a concerning prevalence of an egotistical perspective, even among researchers who engage in peer reviewing.

Authors

Institutions

Publication Details

Journal
Research Evaluation
Published
2024-12-27
DOI
https://doi.org/10.1093/reseval/rvaf021
Citations
4
Primary Topic
scientometrics and bibliometrics research
Type
article
Field-Weighted Citation Impact
1.85

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A typology of peer-reviewers: role, characteristics, and egoistic and altruistic perspectives

Hugo Horta, João M. Santos
4 citations
Research Evaluation
scientometrics and bibliometrics research
1.85
article

A typology of peer-reviewers: role, characteristics, and egoistic and altruistic perspectives

Hugo Horta, João M. Santos
article en
4 citations

Abstract

Abstract There is a growing amount of research on peer reviewing, not only to obtain a better understanding of it as a key pillar of contemporary science but also because the peer review system is increasingly perceived to be in a state of crisis. Based on a sample of researchers in a variety of scientific fields and geographical locations, this study contributes to a better understanding of who engages in peer reviewing activities. It uses three measures of peer reviewing activity (i.e. number of peer reviews, length of the referee report, and review-to-publication ratio) to create a typology of peer review engagement, and identifies three disproportionally sized clusters of peer review engagement: selfish reviewers (accounting for almost two-thirds of the sample), diligent referees (∼30%), and prolific reviewers (<4%). This typology also permits the identification of a specialization of peer reviewing based on the two main purposes of peer reviewing. Specifically, diligent referees focus on development and improvement, and prolific reviewers focus on gatekeeping and quality control. Demographic (age, gender), professional (academic inbreeding), organizational (resources), and dimensions of the strategic research agendas of researchers characterize all three of the clusters, often in diverse manners. The findings underline a concerning prevalence of an egotistical perspective, even among researchers who engage in peer reviewing.

Research EvaluationVol. 34
Iscte – Instituto Universitário de Lisboa (PT), University of Hong Kong (HK)
Fundação para a Ciência e a Tecnologia
Gender equality
Openalex Percentile: Top 12%
scientometrics and bibliometrics research
1.85
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.