Contrast-enhanced US Bosniak Classification: intra- and inter-rater agreement, confounding features, and diagnostic performance

Abstract Background The contrast-enhanced US (CEUS) Bosniak classification, proposed by the European Federation for Ultrasound in Medicine and Biology (EFSUMB) in 2020, predicts malignancy in cystic renal masses (CRMs). However, intra- and inter-rater reproducibility for CEUS features has not been well investigated. Purpose To explore intra- and inter-rater agreement for US features, identify confounding features, and assess the diagnostic performance of CEUS Bosniak classification. Materials and methods This retrospective study included patients with complex CRMs who underwent CEUS examination from January 2013 to August 2023. Radiologists (3 experts and 3 novices) evaluated calcification, echogenic content, wall, septa, and internal nodules of CRMs using CEUS Bosniak classification. Intra- and inter-rater agreements were assessed using the Gwet agreement coefficient (Gwet’s AC). Linear regression identified features associated with discrepancies in Bosniak category assignment. Diagnostic performance was evaluated using the area under the receiver operating characteristic curve (AUC). Results A total of 103 complex CRMs were analyzed in 103 patients (mean age, 50 ± 15 years; 66 males). Intra-rater agreement for the Bosniak category was substantial to almost perfect (Gwet’s AC 0.73–0.87). Inter-rater agreement was substantial for the Bosniak category (Gwet’s AC 0.75) and moderate to almost perfect for US features (Gwet’s AC 0.44–0.94). Nodule variation (i.e., absence vs. obtuse margin vs. acute margin) explained 84% of the variability in the Bosniak category assignment. CEUS Bosniak classification showed good diagnostic performance, with AUCs ranging from 0.78 to 0.90 for each rater. Conclusions CEUS Bosniak classification demonstrated substantial intra- and inter-rater reproducibility and good diagnostic performance in predicting the malignancy potential of CRMs. Nodule variations significantly predicted differences in Bosniak category assignments. Critical relevance statement Contrast-enhanced US Bosniak classification reliably predicts malignancy in cystic renal masses, demonstrating substantial reproducibility and diagnostic accuracy. This improves clinical decision-making and patient management. Key Points Intra- and inter-rater reproducibility for contrast-enhance US features for Bosniak classification have not been well investigated. Substantial inter-rater agreements for the Bosniak category and variable agreements for determining imaging features were found. Contrast-enhanced US Bosniak classification is reproducible and has good diagnostic performance for predicting malignancy in cystic renal masses. Graphical Abstract