Research quality metrics as a complement to bibliometrics: an opinion paper

Abstract Substantial proportions of research investment may be wasted due to flawed study design, biased reporting, and publication bias, raising concerns about how research performance is evaluated. Despite this, current assessment systems rely heavily on bibliometric indicators such as publication counts, co-authorship, and citation metrics, which do not reliably reflect research quality or scientific rigor. In this opinion paper, we argue that such indicators may reward practices that undermine the accumulation of reliable knowledge, including p-hacking, selective reporting, and underpowered study designs, while undervaluing essential contributions such as replication research. We propose that bibliometric measures should be complemented by transparent and auditable research quality metrics, including indicators of reproducibility, statistical power, risk of bias, and adherence to reporting standards. We further suggest that recent advances in large language models may facilitate the scalable implementation of such metrics. Adopting quality-focused indicators could improve research evaluation and help reduce avoidable research waste.

Authors

Institutions

Publication Details

Journal
Scientometrics
Published
2026-09-29
DOI
https://doi.org/10.1007/s11192-026-05840-6
Primary Topic
scientometrics and bibliometrics research
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
article

Research quality metrics as a complement to bibliometrics: an opinion paper

Harald Hannerz, Kristian Schultz Hansen, Jan Hyld Pejtersen, Helene Kless Willadsen
Scientometrics
scientometrics and bibliometrics research
article

Research quality metrics as a complement to bibliometrics: an opinion paper

Harald Hannerz, Kristian Schultz Hansen, Jan Hyld Pejtersen, Helene Kless Willadsen
article en

Abstract

Abstract Substantial proportions of research investment may be wasted due to flawed study design, biased reporting, and publication bias, raising concerns about how research performance is evaluated. Despite this, current assessment systems rely heavily on bibliometric indicators such as publication counts, co-authorship, and citation metrics, which do not reliably reflect research quality or scientific rigor. In this opinion paper, we argue that such indicators may reward practices that undermine the accumulation of reliable knowledge, including p-hacking, selective reporting, and underpowered study designs, while undervaluing essential contributions such as replication research. We propose that bibliometric measures should be complemented by transparent and auditable research quality metrics, including indicators of reproducibility, statistical power, risk of bias, and adherence to reporting standards. We further suggest that recent advances in large language models may facilitate the scalable implementation of such metrics. Adopting quality-focused indicators could improve research evaluation and help reduce avoidable research waste.

Scientometrics
National Research Centre for the Working Environment (DK), VIVE - The Danish Center for Social Science Research (DK)
Openalex Percentile: Top 9%
scientometrics and bibliometrics research
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Research quality metrics as a complement to bibliometrics: an opinion paper — Harald Hannerz, Kristian Schultz Hansen, et al. · Scientometrics (2026) | TGRS Research Map | TGRS