A Tool for Agreement and Alignment Analysis in Binary Rating Tasks: The R Package scindex
scindex is an R package for analysing inter-rater reliability in binary classification tasks. The package computes Cohen’s κ and Fleiss’ κ and, when ground-truth labels are available, estimates signal detection theory parameters, including sensitivity, specificity, and decision thresholds. It also implements the Strategic Convergence Index (SCI), a measure of convergence in raters’ response criteria.
Authors
- Irene Gianeselli (ORCID: https://orcid.org/0000-0002-8689-3035)
Institutions
- Free University of Bozen-Bolzano (IT)
Publication Details
- Journal
- Applied Psychological Measurement
- Published
- 2026-06-30
- DOI
- https://doi.org/10.1177/01466216261465629
- Primary Topic
- Reliability and Agreement in Measurement
- Type
- article
- Field-Weighted Citation Impact
- 0.00