Four overlooked errors in ROC analysis: how to prevent and avoid

Diagnostic tests are frequently applied within clinical practice to assist with disease diagnosis, differential diagnosis, disease grading and prognosis evaluation. Receiver operating characteristic (ROC) curve analysis is one common approach for analysing discriminative performance of a diagnostic test, where it can determine the optimal cut-off value with the best diagnostic performance.1 However, as a majority of clinicians are non-statisticians, several errors have been observed in clinical research when applying ROC curves. These errors may be misleading in the selection of diagnostic tests and disease diagnosis, thus adding to patient burden. To address these errors, clinicians do not need a deep understanding of the intricate mathematical formulas of ROC analysis, but should develop basic knowledge and skills to prevent or avoid commonly overlooked mistakes. This article aims to guide clinicians to avoid common pitfalls in ROC analysis.

Authors

Institutions

Publication Details

Journal
BMJ evidence-based medicine
Published
2024-09-19
DOI
https://doi.org/10.1136/bmjebm-2024-113078
Citations
4
Primary Topic
Imbalanced Data Classification Techniques
Type
article
Field-Weighted Citation Impact
1.39

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Four overlooked errors in ROC analysis: how to prevent and avoid

Manshu Song, Xuerui Tan, Zhuoqiao He, Wei Wang et al.
4 citations
BMJ evidence-based medicine
Imbalanced Data Classification Techniques
1.39
article

Four overlooked errors in ROC analysis: how to prevent and avoid

Manshu Song, Xuerui Tan, Zhuoqiao He, Wei Wang, Qingying Zhang
article en
4 citations

Abstract

Diagnostic tests are frequently applied within clinical practice to assist with disease diagnosis, differential diagnosis, disease grading and prognosis evaluation. Receiver operating characteristic (ROC) curve analysis is one common approach for analysing discriminative performance of a diagnostic test, where it can determine the optimal cut-off value with the best diagnostic performance.1 However, as a majority of clinicians are non-statisticians, several errors have been observed in clinical research when applying ROC curves. These errors may be misleading in the selection of diagnostic tests and disease diagnosis, thus adding to patient burden. To address these errors, clinicians do not need a deep understanding of the intricate mathematical formulas of ROC analysis, but should develop basic knowledge and skills to prevent or avoid commonly overlooked mistakes. This article aims to guide clinicians to avoid common pitfalls in ROC analysis.

BMJ evidence-based medicineVol. 30(3)
Edith Cowan University (AU), Shantou University (CN), Ji Hua Laboratory (CN), First Affiliated Hospital of Shantou University Medical College (CN), Shantou University Medical College (CN), Shandong First Medical University (CN)
Shantou University, National Natural Science Foundation of China, Shantou University Medical College, National Health and Medical Research Council, Division of Graduate Education
Climate action
Openalex Percentile: Top 15%
Imbalanced Data Classification Techniques
1.39
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Four overlooked errors in ROC analysis: how to prevent and avoid — Manshu Song, Xuerui Tan, et al. · BMJ evidence-based medicine (2024) | TGRS Research Map | TGRS