Bayesian Gower agreement for categorical data
In this work I present two methods for measuring agreement in nominal and ordinal data. The measures, which employ Gower-type distances, are simple, intuitive, and easy to compute for any number of units and any number of coders. Influential units and/or coders are easily identified. I consider both one-way and two-way random sampling designs, and develop an approach to Bayesian inference for each. I apply the methods to simulated data and to two real datasets, the first from a one-way radiological study of congenital diaphragmatic hernia, and the second from a two-way study of psychiatric diagnosis. Finally, I consider agreement scales and suggest that Gaussian mutual information can perhaps provide a scale that is more useful than the scale most commonly used. The methods I propose are supported by my open source R package, goweragreement, which is available on the Comprehensive R Archive Network.
Authors
- John P. Hughes (ORCID: https://orcid.org/0000-0002-8816-6800)
Institutions
- Lehigh University (US)
Publication Details
- Journal
- Scientific Reports
- Published
- 2025-02-24
- DOI
- https://doi.org/10.1038/s41598-025-90873-9
- Primary Topic
- Reliability and Agreement in Measurement
- Type
- article
- Field-Weighted Citation Impact
- 0.00