Free science (and not): trying open peer review in the country of state evaluation of research

Informal peer review is - or used to be - embedded in scientific debate. However, for political reasons, formal and closed peer review became the standard for the administrative evaluation of research during the Cold War years. This formal peer review, based on a kind of procedural ipse dixit, destroyed the open-ended nature of scientific debate, turning its results into a ritualised collection of tokens for the sake of careers rather than science. Can peer review truly be open (or free) if it is subject to administrative evaluation and must adhere to the procedures defined by the evaluation agency? If not, we should turn the COARA principles on their head: before trying to change how research is assessed, we should ask who is entitled to evaluate it and question the centralised evaluation agencies that need strict procedures as a weapon of mass evaluation.

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2025-06-18
DOI
https://doi.org/10.5281/zenodo.15691031
Primary Topic
Evaluation and Performance Assessment
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Free science (and not): trying open peer review in the country of state evaluation of research

Zenodo (CERN European Organization for Nuclear Research)
Evaluation and Performance Assessment
article

Free science (and not): trying open peer review in the country of state evaluation of research

article en

Abstract

Informal peer review is - or used to be - embedded in scientific debate. However, for political reasons, formal and closed peer review became the standard for the administrative evaluation of research during the Cold War years. This formal peer review, based on a kind of procedural ipse dixit, destroyed the open-ended nature of scientific debate, turning its results into a ritualised collection of tokens for the sake of careers rather than science. Can peer review truly be open (or free) if it is subject to administrative evaluation and must adhere to the procedures defined by the evaluation agency? If not, we should turn the COARA principles on their head: before trying to change how research is assessed, we should ask who is entitled to evaluate it and question the centralised evaluation agencies that need strict procedures as a weapon of mass evaluation.

Zenodo (CERN European Organization for Nuclear Research)
University of Pisa (IT)
Openalex Percentile: Top 52%
Evaluation and Performance Assessment
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.