Training a Vision Transformer Model on Shape Signatures for Quality Control of MRI Corpus Callosum Segmentations
The corpus callosum (CC) is a vital brain structure for inter-hemispheric communication. Precise segmentation of the CC from magnetic resonance imaging is used to evaluate neurological conditions and is also associated with various individual characteristics. However, studies on quality control (QC) for segmentations are still scarce, even though they are especially necessary when automatic techniques are employed. This work explores the self-attention component of Vision Transformer (ViT) model for performing QC of CC MRI-based segmentations. Instead of feeding the ViT model with the MR image itself, the model is fed with a set of shape descriptors in several scales. This set of shape signatures is able of capturing at the same time a general shape of the CC, but also some details of the structure. Results highlight the potential of ViT models and curvature profile descriptors for the QC of CC segmentation, achieving 99% area under the curve (AUC), ensuring precision and efficiency in the evaluation of medical images through a methodology agnostic to the type of image acquisition and segmentation method.
Authors
- Letícia Rittner (ORCID: https://orcid.org/0000-0001-8182-5554)
- Paulo Rogério Júlio
- Joany Rodrigues (ORCID: https://orcid.org/0000-0001-5429-0195)
- Severiano R. Silva (ORCID: https://orcid.org/0000-0002-7045-2075)
- Simone Appenzeller (ORCID: https://orcid.org/0000-0001-5075-4474)
Institutions
- Universidade Estadual de Campinas (UNICAMP) (BR)
Publication Details
- Published
- 2024-11-13
- DOI
- https://doi.org/10.1109/sipaim62974.2024.10783553
- Primary Topic
- Brain Tumor Detection and Classification
- Type
- article
- Field-Weighted Citation Impact
- 0.00