A comprehensive guide to study the agreement and reliability of multi-observer ordinal data

The present paper completes existing guidelines, such as the Guidelines for Reporting Reliability and Agreement Studies (GRRAS), to improve the quality of reliability and agreement studies of clinical tests. Furthermore, we provide open source software to researchers with minimum programming skills.

Authors

Institutions

Publication Details

Journal
BMC Medical Research Methodology
Published
2024-12-20
DOI
https://doi.org/10.1186/s12874-024-02431-y
Citations
12
Primary Topic
Reliability and Agreement in Measurement
Type
article
Field-Weighted Citation Impact
5.54
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A comprehensive guide to study the agreement and reliability of multi-observer ordinal data

Sophie Vanbelle, Ellen Blix, Christina Hernandez Engelhart
12 citations
BMC Medical Research Methodology
Reliability and Agreement in Measurement
5.54
article

A comprehensive guide to study the agreement and reliability of multi-observer ordinal data

Sophie Vanbelle, Ellen Blix, Christina Hernandez Engelhart
article en
12 citations

Abstract

The present paper completes existing guidelines, such as the Guidelines for Reporting Reliability and Agreement Studies (GRRAS), to improve the quality of reliability and agreement studies of clinical tests. Furthermore, we provide open source software to researchers with minimum programming skills.

BMC Medical Research MethodologyVol. 24(1)
Oslo University Hospital (NO), OsloMet – Oslo Metropolitan University (NO), Maastricht University (NL)
Quality Education
Openalex Percentile: Top 4%
Reliability and Agreement in Measurement
5.54
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.