Beyond Lin's concordance: a one-stage hierarchical framework for validating standard area diagrams for plant disease severity

Standard area diagrams (SADs) are usually validated by computing Lin’s concordance correlation coefficient (ρc) for each rater and comparing means between conditions. This two-stage analysis tells whether agreement improved on average, but not where along the severity range a SAD helps or compromises, nor whether it acts on bias, calibration or precision. We propose a one-stage hierarchical framework: a mixed model of all severity estimates, with bias and calibration for each condition, intercepts and slopes for each rater and method, image effects and a residual variance that changes with severity, and a generalised additive mixed model. From it we derive curves of bias, variation among raters and the expected absolute error (EAE), and differences between conditions with simultaneous bands. In simulations, the paired t test on ρc detected a SAD that only corrected calibration in 7% of studies, against 33% for the one-stage likelihood ratio test, when the model let each rater respond differently to each method. Reanalysis of five published studies (one, two and four SADs) refined every original conclusion: a significant gain in ρc worth only 0.2–0.5 percentage points (p.p.) of EAE; a SAD that traded overestimation at low severity for underestimation of up to 9 p.p. at high severity; two SADs equivalent by ρc that differed in accuracy at moderate to high severity; and four SADs indistinguishable by ρc that, in the linear model, differed in bias up to 28% severity. The framework, implemented in the R package r4pde, shows where, how and by how much a SAD changes accuracy.

Authors

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-11-14
DOI
https://doi.org/10.5281/zenodo.24233430
Primary Topic
Reliability and Agreement in Measurement
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

Beyond Lin's concordance: a one-stage hierarchical framework for validating standard area diagrams for plant disease severity

Kaique S. Alves, Emerson M. Del Ponte
Zenodo (CERN European Organization for Nuclear Research)
Reliability and Agreement in Measurement
preprint

Beyond Lin's concordance: a one-stage hierarchical framework for validating standard area diagrams for plant disease severity

Kaique S. Alves, Emerson M. Del Ponte
preprint en

Abstract

Standard area diagrams (SADs) are usually validated by computing Lin’s concordance correlation coefficient (ρc) for each rater and comparing means between conditions. This two-stage analysis tells whether agreement improved on average, but not where along the severity range a SAD helps or compromises, nor whether it acts on bias, calibration or precision. We propose a one-stage hierarchical framework: a mixed model of all severity estimates, with bias and calibration for each condition, intercepts and slopes for each rater and method, image effects and a residual variance that changes with severity, and a generalised additive mixed model. From it we derive curves of bias, variation among raters and the expected absolute error (EAE), and differences between conditions with simultaneous bands. In simulations, the paired t test on ρc detected a SAD that only corrected calibration in 7% of studies, against 33% for the one-stage likelihood ratio test, when the model let each rater respond differently to each method. Reanalysis of five published studies (one, two and four SADs) refined every original conclusion: a significant gain in ρc worth only 0.2–0.5 percentage points (p.p.) of EAE; a SAD that traded overestimation at low severity for underestimation of up to 9 p.p. at high severity; two SADs equivalent by ρc that differed in accuracy at moderate to high severity; and four SADs indistinguishable by ρc that, in the linear model, differed in bias up to 28% severity. The framework, implemented in the R package r4pde, shows where, how and by how much a SAD changes accuracy.

Zenodo (CERN European Organization for Nuclear Research)
Universidade Federal de Viçosa (BR), Bayer (Germany) (DE)
Reliability and Agreement in Measurement
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon