Reducing Motion Artifacts in Brain MRI Using Vision Transformers and Self-Supervised Learning
Vision Transformer (ViT) has become a state-of-art in many vision tasks, owing to its great scalability and promising performance. In Magnetic Resonance Imaging (MRI), motion continues to be a major problem, which degrades the image quality and the corresponding disease assessment. The purpose of this work is to assess a ViT-based MRI motion correction method. Self-supervised learning was further incorporated to enhance the motion correction effects. Training image pairs were generated starting with in-house MRI data of high quality, from which simulated images with artifacts were generated using a k -space resampling algorithm based on real head movements. We randomly mask $50 \%$ patches of the input image and reconstruct the missing pixels as self-supervised pre-training to boost performance of the ViT model. The output images of the proposed method from motion-corrupted data had significantly improved image quality compared with the original corrupted images and are better than the results of a previous deep learning-based motion correction algorithm: the UNet-based MC-Net and a baseline ViT based method in terms of quantitative metrics. This study offers a practical approach for elimination of motion artifacts from brain MRI, using self-supervised learning and ViT.
Authors
- Elias R. Melhem (ORCID: https://orcid.org/0000-0001-5869-9449)
- Edward H. Herskovits (ORCID: https://orcid.org/0000-0001-9445-1774)
- Lei Zhang (ORCID: https://orcid.org/0000-0002-9702-6738)
- Linda Chang (ORCID: https://orcid.org/0000-0002-1267-0699)
- Thomas Ernst (ORCID: https://orcid.org/0000-0002-2170-9241)
- Ze Wang (ORCID: https://orcid.org/0009-0000-4619-7943)
- Xiaoke Wang (ORCID: https://orcid.org/0000-0002-2421-3970)
Institutions
- University of Maryland, Baltimore (US)
Publication Details
- Published
- 2024-09-27
- DOI
- https://doi.org/10.1109/icip51287.2024.10647626
- Primary Topic
- Medical Image Segmentation Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.00