ESC-UNET: A hybrid CNN and Swin Transformers for skin lesion segmentation

One of the most important tasks in computer-aided diagnostics is the automatic segmentation of skin lesions, which plays an essential role in the early diagnosis and treatment of skin cancer. In recent years, the Convolutional Neural Network (CNN) has largely replaced other traditional methods for segmenting skin lesions. However, due to insufficient information and unclear lesion region segmentation, skin lesion image segmentation still has challenges. In this paper, we propose a novel deep medical image segmentation approach named ”ESC-UNET” which combines the advantages of CNN and Transformer to effectively leverage local information and long-range dependencies to enhance medical image segmentation. In terms of the local information, we use a CNN-based encoder and decoder framework. The CNN branch mines local information from medical images using the locality of convolution processes and the pre-trained EfficientNetB5 network. As for the long-range dependencies, we build a Transformer branch that emphasizes the global context. In addition, we employ Atrous Spatial Pyramid Pooling (ASPP) to gather network-wide relevant information. The Convolution Block Attention Module (CBAM) is added to the model to promote effective features and suppress ineffective features in segmentation. We have evaluated our network using the ISIC 2016, ISIC 2017, and ISIC 2018 datasets. The results demonstrate the efficiency of the proposed model in segmenting skin lesions. • ESC-UNET introduces a novel deep segmentation framework combining Convolutional Neural Networks (CNNs) and Transformers to leverage both local information and long-range dependencies for enhanced skin lesion segmentation. • ESC-UNET utilizes the EfficientNetB5 network as a pre-trained CNN encoder- decoder backbone to capture detailed local features from medical images effectively. • ESC-UNET incorporates a Transformer branch to emphasize global contextual information, addressing the challenges of unclear lesion region boundaries. • ESC-UNET employs Atrous Spatial Pyramid Pooling (ASPP) for multi-scale feature extraction and integrates a Convolution Block Attention Module (CBAM) to highlight relevant features and suppress irrelevant ones.