Improving Uncertainty-Error Correspondence in Deep Bayesian Medical Image Segmentation

Increased usage of automated tools like deep learning in medical image segmentation has alleviated the bottleneck of manual contouring. This has shifted manual labour to quality assessment (QA) of automated contours which involves detecting errors and correcting them. A potential solution to semi-automated QA is to use deep Bayesian uncertainty to recommend potentially erroneous regions, thus reducing time spent on error detection. Previous work has investigated the correspondence between uncertainty and error, however, no work has been done on improving the “utility” of Bayesian uncertainty maps such that it is only present in inaccurate regions and not in the accurate ones. Our work trains the FlipOut model with the Accuracy-vs-Uncertainty (AvU) loss which promotes uncertainty to be present only in inaccurate regions. We apply this method on datasets of two radiotherapy body sites, c.f. head-and-neck CT and prostate MR scans. Uncertainty heatmaps (i.e. predictive entropy) are evaluated against voxel inaccuracies using Receiver Operating Characteristic (ROC) and Precision-Recall (PR) curves. Numerical results show that when compared to the Bayesian baseline the proposed method successfully suppresses uncertainty for accurate voxels, with similar presence of uncertainty for inaccurate voxels. Code to reproduce experiments is available at <a href='https://github.com/prerakmody/bayesuncertainty-error-correspondence'>https://github.com/prerakmody/bayesuncertainty-error-correspondence</a>

Authors

Institutions

Publication Details

Journal
The Journal of Machine Learning for Biomedical Imaging
Published
2024-08-31
DOI
https://doi.org/10.59275/j.melba.2024-5gc8
Citations
1
Primary Topic
AI in cancer detection
Type
article
Field-Weighted Citation Impact
0.35

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Improving Uncertainty-Error Correspondence in Deep Bayesian Medical Image Segmentation

Nicolas F. Chaves-de-Plaza, Marius Staring, Klaus Hildebrandt, Chinmay Rao et al.
1 citations
The Journal of Machine Learning for Biomedical Imaging
AI in cancer detection
0.35
article

Improving Uncertainty-Error Correspondence in Deep Bayesian Medical Image Segmentation

Nicolas F. Chaves-de-Plaza, Marius Staring, Klaus Hildebrandt, Chinmay Rao, Prerak Mody, Nienke Hoekstra, Mischa de Ridder, Eleftheria Astrenidou
article en
1 citations

Abstract

Increased usage of automated tools like deep learning in medical image segmentation has alleviated the bottleneck of manual contouring. This has shifted manual labour to quality assessment (QA) of automated contours which involves detecting errors and correcting them. A potential solution to semi-automated QA is to use deep Bayesian uncertainty to recommend potentially erroneous regions, thus reducing time spent on error detection. Previous work has investigated the correspondence between uncertainty and error, however, no work has been done on improving the “utility” of Bayesian uncertainty maps such that it is only present in inaccurate regions and not in the accurate ones. Our work trains the FlipOut model with the Accuracy-vs-Uncertainty (AvU) loss which promotes uncertainty to be present only in inaccurate regions. We apply this method on datasets of two radiotherapy body sites, c.f. head-and-neck CT and prostate MR scans. Uncertainty heatmaps (i.e. predictive entropy) are evaluated against voxel inaccuracies using Receiver Operating Characteristic (ROC) and Precision-Recall (PR) curves. Numerical results show that when compared to the Bayesian baseline the proposed method successfully suppresses uncertainty for accurate voxels, with similar presence of uncertainty for inaccurate voxels. Code to reproduce experiments is available at <a href='https://github.com/prerakmody/bayesuncertainty-error-correspondence'>https://github.com/prerakmody/bayesuncertainty-error-correspondence</a>

The Journal of Machine Learning for Biomedical ImagingVol. 2(August 2024)
Leiden University Medical Center (NL), University Medical Center Utrecht (NL), Proton Therapy Centre (CZ), Delft University of Technology (NL)
Siemens Healthineers
Decent work and economic growth
Openalex Percentile: Top 34%
AI in cancer detection
0.35
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.