FAIR Metrics for Motivating Excellence in Peer Review

Past attempts to measure the quality of peer review have relied on either subjective ratings or tangentially related factors such as the sheer number or length of reviews. Previously, we introduced the Fair Attribution to Indexed Reports (FAIR) Metrics to quantify adherence to good citation practices via systematic semantic comparison of statements in the target document to those found in cited and uncited prior reports. In the present work, we define new FAIR Metrics for assessing the quality of peer review, extend the FAIR Metrics module of the PDP-DREAM Ontology with additional classes and properties needed to record FAIR Metrics analysis of a peer review, and demonstrate use with a simple example.

Authors

Institutions

Publication Details

Published
2024-09-16
DOI
https://doi.org/10.1109/e-science62913.2024.10678726
Citations
3
Primary Topic
Research Data Management Practices
Type
article
Field-Weighted Citation Impact
2.34
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

FAIR Metrics for Motivating Excellence in Peer Review

Carl Taswell, Adam Craig
3 citations
Research Data Management Practices
2.34
article

FAIR Metrics for Motivating Excellence in Peer Review

Carl Taswell, Adam Craig
article en
3 citations

Abstract

Past attempts to measure the quality of peer review have relied on either subjective ratings or tangentially related factors such as the sheer number or length of reviews. Previously, we introduced the Fair Attribution to Indexed Reports (FAIR) Metrics to quantify adherence to good citation practices via systematic semantic comparison of statements in the target document to those found in cited and uncited prior reports. In the present work, we define new FAIR Metrics for assessing the quality of peer review, extend the FAIR Metrics module of the PDP-DREAM Ontology with additional classes and properties needed to record FAIR Metrics analysis of a peer review, and demonstrate use with a simple example.

Hong Kong Baptist University (HK), University of California San Diego (US)
Openalex Percentile: Top 9%
Research Data Management Practices
2.34
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.