Development and validation of a methodology to simulate interobserver variability
OBJECTIVE: Contouring for radiotherapy planning remains time intensive. As such, interobserver contour variation (IOV) studies are limited in patient and/or observer numbers (1). This study provides a methodology to simulate IOV on images containing a single contour. Approach. 14 gynaecological cancer radiotherapy target volumes delineated by five observers on T2W-MRI scans were used to develop an AI-based approach and three rule-based (simple, normal, adapted) approaches to generate estimated minimum and maximum (min/max) contours. The rule-based approaches used delineation uncertainty of the observers' contours. The AI-based approach combined seven nnU-Net models into an ensemble. The development of the AI-based and rule-based approaches utilised 7-fold and leave-one-out cross validation, respectively. Validation used a separate/second dataset with the same characteristics and six observers. A single contour was used as the basis and the remaining five contours were used to generate the min/max contours Performance of each approach was assessed using dice similarity coefficient (DSC), mean surface distance (MSD), surface DSC (sDSC) and Hausdorff distance (HD). The best approach was utilised in a pipeline to generate a min/max contour. Multiple contours were generated between these by applying non-uniform expansions and contractions to a single contour. The comparison metrics of the observers' and simulated contours were computed in pairwise, with a mean and standard deviation calculated. Main Results. The adapted rule-based approach performed best across all metrics and was used in the subsequent pipeline. The AI-based approach had comparative median values to the rule-based approaches, but a much wider range of values. The observers' and simulated contours had a DSC of 0.77±0.13 and 0.78±0.20, respectively and an MSD of 2.4±1.7 mm and 2.2±1.5 mm, respectively. Significance. This study provides a methodology to generate additional observer contours from a single observer contour based on IOV data.
Authors
- Rhianna Brown (ORCID: https://orcid.org/0000-0003-1040-4757)
- Amy Walker (ORCID: https://orcid.org/0000-0002-6328-9994)
- Karen Lim (ORCID: https://orcid.org/0000-0002-4861-2108)
- Lois Charlotte Holloway (ORCID: https://orcid.org/0000-0003-4337-2165)
- Peter E. Metcalfe (ORCID: https://orcid.org/0000-0002-6820-0055)
- Dean L. Cutajar (ORCID: https://orcid.org/0000-0002-4384-7856)
- Phillip Chlap (ORCID: https://orcid.org/0000-0002-6517-8745)
Institutions
- University of Wollongong (AU)
- Ingham Institute (AU)
Publication Details
- Journal
- Biomedical Physics & Engineering Express
- Published
- 2026-11-17
- DOI
- https://doi.org/10.1088/2057-1976/aec2f2
- Primary Topic
- Advanced Radiotherapy Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.00