Swin UNet: a memory-efficient and accurate deep learning model for medical image segmentation

Medical image segmentation is a challenging and important task that aims to identify and separate different anatomical structures or pathological regions from complex and noisy image data. However, most existing deep learning models for medical image segmentation are based on convolutional neural networks (CNNs), which have high memory consumption and limited spatial reasoning capabilities. In this paper, we propose a novel deep learning model for medical image segmentation based on Swin UNET, which combines the self-attention mechanism of Swin Transformer and the encoder-decoder architecture of U-Net. We also propose a memory management strategy that optimizes the number of heads of the multi-head self-attention mechanism using probabilistic mirror flipping and grid search. We conduct extensive experiments on a challenging medical image segmentation dataset and demonstrate that our model and strategy achieve comparable or better accuracy than the state-of-the-art models while significantly reducing the memory usage. Our model and strategy are robust and generalizable, as they can handle arbitrary input resolutions, scales, and modalities, and achieve state-of-the-art performance on a challenging medical image segmentation dataset. Our study contributes to the advancement of the research field of medical image segmentation, and provides a practical and scalable solution for real-world application scenarios with limited resources.

Authors

Institutions

Publication Details

Published
2024-08-16
DOI
https://doi.org/10.1117/12.3035725
Citations
1
Primary Topic
Radiomics and Machine Learning in Medical Imaging
Type
article
Field-Weighted Citation Impact
0.40
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Swin UNet: a memory-efficient and accurate deep learning model for medical image segmentation

Jiachen Pan
1 citations
Radiomics and Machine Learning in Medical Imaging
0.40
article

Swin UNet: a memory-efficient and accurate deep learning model for medical image segmentation

Jiachen Pan
article en
1 citations

Abstract

Medical image segmentation is a challenging and important task that aims to identify and separate different anatomical structures or pathological regions from complex and noisy image data. However, most existing deep learning models for medical image segmentation are based on convolutional neural networks (CNNs), which have high memory consumption and limited spatial reasoning capabilities. In this paper, we propose a novel deep learning model for medical image segmentation based on Swin UNET, which combines the self-attention mechanism of Swin Transformer and the encoder-decoder architecture of U-Net. We also propose a memory management strategy that optimizes the number of heads of the multi-head self-attention mechanism using probabilistic mirror flipping and grid search. We conduct extensive experiments on a challenging medical image segmentation dataset and demonstrate that our model and strategy achieve comparable or better accuracy than the state-of-the-art models while significantly reducing the memory usage. Our model and strategy are robust and generalizable, as they can handle arbitrary input resolutions, scales, and modalities, and achieve state-of-the-art performance on a challenging medical image segmentation dataset. Our study contributes to the advancement of the research field of medical image segmentation, and provides a practical and scalable solution for real-world application scenarios with limited resources.

University of Toronto (CA)
Openalex Percentile: Top 36%
Radiomics and Machine Learning in Medical Imaging
0.40
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Swin UNet: a memory-efficient and accurate deep learning model for medical image segmentation — Jiachen Pan · (2024) | TGRS Research Map | TGRS