Interobserver Variability and Cytotechnologist Performance in Digital Cervical Cytology: An International European Federation of Cytological Societies Study

ABSTRACT Background Whole‐slide imaging (WSI) is increasingly incorporated into digital cervical cytology workflows; however, interpretive variability in borderline and low‐grade squamous lesions remains a recognized diagnostic challenge. This study evaluated interobserver agreement among cytotechnologists in WSI‐based cervical cytology, focusing on borderline and low‐grade squamous lesions. Methods Sixty‐eight cervical cytology cases (31 ASC‐US, 19 NILM, 18 LSIL) were independently assessed by 19 cytotechnologists across two WSI‐based evaluation rounds. One participant was excluded due to incomplete evaluations in Round 1. Interobserver agreement was evaluated using Fleiss' kappa, Kendall's W , intraclass correlation coefficient, Krippendorff's alpha, Cronbach's alpha and Spearman rank correlation. Conclusions Digital assessment using WSI demonstrated moderate interobserver agreement among cytotechnologists, with the greatest variability observed in ASC‐US cases. Repeated evaluation was associated with high internal consistency. Findings are compatible with interpretive variability; WSI‐specific effects cannot be excluded without a direct comparator. Paired rater medians did not differ significantly (4.38 vs. 4.00 min; p = 0.090).

Authors

Institutions

Publication Details

Journal
Cytopathology
Published
2026-10-29
DOI
https://doi.org/10.1111/cyt.70141
Primary Topic
Cervical Cancer and HPV Research
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Interobserver Variability and Cytotechnologist Performance in Digital Cervical Cytology: An International European Federation of Cytological Societies Study

Ľubomír Rusňák, Ivana Kholová, Danijela Vrdoljak‐Mozetič, Mohammed S. I. Mansour et al.
Cytopathology
Cervical Cancer and HPV Research
article

Interobserver Variability and Cytotechnologist Performance in Digital Cervical Cytology: An International European Federation of Cytological Societies Study

Ľubomír Rusňák, Ivana Kholová, Danijela Vrdoljak‐Mozetič, Mohammed S. I. Mansour, Martina Krehelova, Philippe Seurat, Maria Nasioutziki, Zuzana Urbancikova, Hervé Debaque, Arrigo Capitanio, Hatice Elmas, Ambrogio Fassina, Giovanni Negri, Laura Ventura, Vladimir Bašić, Mária Bačová, Lia J. M. van Zuijlen‐Manders, Béatrix Cochand‐Priollet, Corinne Selle, Sara Bazzon, Stacke K.A., Mária Lőkösová, David Backlund, Elena Schulmeister, Katrína Hakošová, Daniel Carrasco Bernal, Sandra Bessac, Lorena Quintana Barrilero, Nadine Eckert, Carolina Anton Lorenzo
article en

Abstract

ABSTRACT Background Whole‐slide imaging (WSI) is increasingly incorporated into digital cervical cytology workflows; however, interpretive variability in borderline and low‐grade squamous lesions remains a recognized diagnostic challenge. This study evaluated interobserver agreement among cytotechnologists in WSI‐based cervical cytology, focusing on borderline and low‐grade squamous lesions. Methods Sixty‐eight cervical cytology cases (31 ASC‐US, 19 NILM, 18 LSIL) were independently assessed by 19 cytotechnologists across two WSI‐based evaluation rounds. One participant was excluded due to incomplete evaluations in Round 1. Interobserver agreement was evaluated using Fleiss' kappa, Kendall's W , intraclass correlation coefficient, Krippendorff's alpha, Cronbach's alpha and Spearman rank correlation. Conclusions Digital assessment using WSI demonstrated moderate interobserver agreement among cytotechnologists, with the greatest variability observed in ASC‐US cases. Repeated evaluation was associated with high internal consistency. Findings are compatible with interpretive variability; WSI‐specific effects cannot be excluded without a direct comparator. Paired rater medians did not differ significantly (4.38 vs. 4.00 min; p = 0.090).

Cytopathology
University of Padua (IT), University of Rijeka (HR), Universität Hamburg (DE), Tampere University (FI), University of Eastern Finland (FI), Lund University (SE), Kristianstad University (SE), Université Paris Cité (FR), Aristotle University of Thessaloniki (GR), Sundsvall Municipality (SE), Sahlgrenska University Hospital (SE), Radboud University Medical Center (NL), Ospedale di Bolzano (IT), Hôpital Cochin (FR), Centre Léon Bérard (FR), University Medical Center Hamburg-Eppendorf (DE), Ippokrateio General Hospital of Thessaloniki (GR), Klinički Bolnički Centar Rijeka (HR), Centre de Recherche en Cancérologie de Lyon (FR), German Center for Lung Research (DE), Fimlab (Finland) (FI), Clinica Universidad de Navarra (ES), Max Planck Institute for Molecular Genetics (DE), Laboratoire National de Santé (LU), Norra Älvsborgs Länssjukhus (SE), Linköping University Hospital (SE), Hallands sjukhus Halmstad (SE), University of Tampere (FI), Unilabs (Switzerland) (CH), Freie Universität Berlin (DE), Universidad de Navarra (ES), Jönköping University (SE)
Openalex Percentile: Top 11%
Cervical Cancer and HPV Research
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon