CancerSeg-XA: Enhanced Breast Cancer Histo-pathology Segmentation Using Xception Backbone with Attention Mechanisms

Breast cancer remains a formidable health challenge requiring advanced computational tools for accurate diagnosis and treatment planning. This study hypothesizes that modifica-tions to the DeepLabV3+ architecture, such as incorporating an attention layer and replacing the ResNet50 backbone with Xcep-tion, can significantly enhance segmentation accuracy and model stability for breast cancer histopathological images. To test this hy-pothesis, we evaluated the performance of the original DeepLabV3+ and three modified versions for semantic segmenta-tion using the “Breast Cancer Semantic Segmentation” (BCSS) da-taset, which provides pixel-wise annotations of breast cancer tis-sues. The proposed modifications include integrating an attention layer between the encoder and decoder (Model 1), replacing the ResNet50 backbone with an Xception backbone up to 'block5' (Model 2), and combining the Xception backbone with the atten-tion layer (CancerSeg-XA). The models were implemented and trained in the Kaggle Notebook environment, and their perfor-mance was assessed based on training and validation accuracy. The results show that Model 1 improved the model stability and accuracy compared to DeepLabV3+, whereas Model 2 and Can-cerSeg-XA achieved significant accuracy improvements of 91.47% and 91.57%, respectively, over the baseline DeepLabV3+ accuracy of 85.7%. CancerSeg-XA demonstrated enhanced training stabil-ity, making it a promising approach for clinical application in breast cancer diagnosis and treatment.