Endogeny in measuring research excellence. In-house publishing and conflict of interests in Polish science evaluation

The ministerial exercise of evaluation of scientific institutions gained a pivotal role in the Polish system of science and higher education after the 2018 reform. The evaluation process under the new rules was concluded in 2022, and in the fields of social sciences and humanities (SSH), it was based to a large extent on domestic publications. We have compiled a sample of articles in journals that exerted the highest impact in the four selected SSH disciplines (over 19 thousand articles in 67 journals) to show elements of partiality in how the evaluation was administered. In particular, we show that a degree of control over a journal prompted a substantially higher share of in-house (endogenous) publications, and we point to clear signs of adaptation by editors to the changes in evaluation rules introduced by the Ministry of Science. The results of that particular national case illustrate that domestic indicators of research excellence are relatively prone to bias, as institutions very often have dual and conflicting roles. • Ministerial research evaluation plays a pivotal role in Polish scientific system. • Evaluation incentivizes adaptation strategies in both researchers and publishers. • Arbitrary changes to ministerial registry played a key role in publishing patterns. • High rank given to domestic journal invited increase in in-house publications. • Degree of control over a journal highly correlated with publishing endogeny.

Authors

Institutions

Publication Details

Journal
Research Policy
Published
2024-10-11
DOI
https://doi.org/10.1016/j.respol.2024.105134
Citations
6
Primary Topic
Innovation Policy and R&D
Type
article
Field-Weighted Citation Impact
6.78
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Endogeny in measuring research excellence. In-house publishing and conflict of interests in Polish science evaluation

Ireneusz Sadowski, Łukasz Zamęcki
6 citations
Research Policy
Innovation Policy and R&D
6.78
article

Endogeny in measuring research excellence. In-house publishing and conflict of interests in Polish science evaluation

Ireneusz Sadowski, Łukasz Zamęcki
article en
6 citations

Abstract

The ministerial exercise of evaluation of scientific institutions gained a pivotal role in the Polish system of science and higher education after the 2018 reform. The evaluation process under the new rules was concluded in 2022, and in the fields of social sciences and humanities (SSH), it was based to a large extent on domestic publications. We have compiled a sample of articles in journals that exerted the highest impact in the four selected SSH disciplines (over 19 thousand articles in 67 journals) to show elements of partiality in how the evaluation was administered. In particular, we show that a degree of control over a journal prompted a substantially higher share of in-house (endogenous) publications, and we point to clear signs of adaptation by editors to the changes in evaluation rules introduced by the Ministry of Science. The results of that particular national case illustrate that domestic indicators of research excellence are relatively prone to bias, as institutions very often have dual and conflicting roles. • Ministerial research evaluation plays a pivotal role in Polish scientific system. • Evaluation incentivizes adaptation strategies in both researchers and publishers. • Arbitrary changes to ministerial registry played a key role in publishing patterns. • High rank given to domestic journal invited increase in in-house publications. • Degree of control over a journal highly correlated with publishing endogeny.

Research PolicyVol. 54(1)
Institute of Political Studies (PL), University of Warsaw (PL), Polish Academy of Sciences (PL)
Openalex Percentile: Top 3%
Innovation Policy and R&D
6.78
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.