Multiple Differential Convolution and Local-Variation Attention UNet: Nucleus Semantic Segmentation Based on Multiple Differential Convolution and Local-Variation Attention

Nucleus accurate segmentation is a crucial task in biomedical image analysis. While convolutional neural networks (CNNs) have achieved notable progress in this field, challenges remain due to the complexity and heterogeneity of cell images, especially in overlapping regions of nuclei. To address the limitations of current methods, we propose a mechanism of multiple differential convolution and local-variation attention in CNNs, leading to the so-called multiple differential convolution and local-variation attention U-Net (MDLA-UNet). The multiple differential convolution employs multiple differential operators to capture gradient and direction information, improving the network’s capability to detect edges. The local-variation attention utilizes Haar discrete wavelet transforms for level-1 decomposition to obtain approximate features, and then derives high-frequency features to enhance the global context and local detail variation of the feature maps. The results on the MoNuSeg, TNBC, and CryoNuSeg datasets demonstrated superior segmentation performance of the proposed method for cells having complex boundaries and details with respect to existing methods. The proposed MDLA-UNet presents the ability of capturing fine edges and details in feature maps and thus improves the segmentation of nuclei with blurred boundaries and overlapping regions.