Reducing Motion Artifacts in Brain MRI Using Vision Transformers and Self-Supervised Learning

Vision Transformer (ViT) has become a state-of-art in many vision tasks, owing to its great scalability and promising performance. In Magnetic Resonance Imaging (MRI), motion continues to be a major problem, which degrades the image quality and the corresponding disease assessment. The purpose of this work is to assess a ViT-based MRI motion correction method. Self-supervised learning was further incorporated to enhance the motion correction effects. Training image pairs were generated starting with in-house MRI data of high quality, from which simulated images with artifacts were generated using a k -space resampling algorithm based on real head movements. We randomly mask $50 \%$ patches of the input image and reconstruct the missing pixels as self-supervised pre-training to boost performance of the ViT model. The output images of the proposed method from motion-corrupted data had significantly improved image quality compared with the original corrupted images and are better than the results of a previous deep learning-based motion correction algorithm: the UNet-based MC-Net and a baseline ViT based method in terms of quantitative metrics. This study offers a practical approach for elimination of motion artifacts from brain MRI, using self-supervised learning and ViT.

Authors

Institutions

Publication Details

Published
2024-09-27
DOI
https://doi.org/10.1109/icip51287.2024.10647626
Primary Topic
Medical Image Segmentation Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Reducing Motion Artifacts in Brain MRI Using Vision Transformers and Self-Supervised Learning

Elias R. Melhem, Edward H. Herskovits, Lei Zhang, Linda Chang et al.
Medical Image Segmentation Techniques
article

Reducing Motion Artifacts in Brain MRI Using Vision Transformers and Self-Supervised Learning

Elias R. Melhem, Edward H. Herskovits, Lei Zhang, Linda Chang, Thomas Ernst, Ze Wang, Xiaoke Wang
article en

Abstract

Vision Transformer (ViT) has become a state-of-art in many vision tasks, owing to its great scalability and promising performance. In Magnetic Resonance Imaging (MRI), motion continues to be a major problem, which degrades the image quality and the corresponding disease assessment. The purpose of this work is to assess a ViT-based MRI motion correction method. Self-supervised learning was further incorporated to enhance the motion correction effects. Training image pairs were generated starting with in-house MRI data of high quality, from which simulated images with artifacts were generated using a k -space resampling algorithm based on real head movements. We randomly mask $50 \%$ patches of the input image and reconstruct the missing pixels as self-supervised pre-training to boost performance of the ViT model. The output images of the proposed method from motion-corrupted data had significantly improved image quality compared with the original corrupted images and are better than the results of a previous deep learning-based motion correction algorithm: the UNet-based MC-Net and a baseline ViT based method in terms of quantitative metrics. This study offers a practical approach for elimination of motion artifacts from brain MRI, using self-supervised learning and ViT.

Vol. 32
University of Maryland, Baltimore (US)
Openalex Percentile: Top 84%
Medical Image Segmentation Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Reducing Motion Artifacts in Brain MRI Using Vision Transformers and Self-Supervised Learning — Elias R. Melhem, Edward H. Herskovits, et al. · (2024) | TGRS Research Map | TGRS