Predicting Microsatellite Instability from Histology Images with Dilated Neighborhood Attention Transformer in Colorectal Cancer
Microsatellite instability (MSI) is a pivotal genetic marker influencing the efficacy of immunotherapy in colorectal cancer. Traditional MSI examination often requires additional genetic or immunohistochemical tests, whereas histology images, widely available in colorectal cancer diagnosis, offer a valuable alternative for MSI prediction. Although Transformer-based models have demonstrated promising outcomes in predicting MSI from histology images, they are hampered by traditional local attention mechanisms that struggle to capture long-range interdependencies and establish a comprehensive global receptive field. In this study, we introduce DiNAT-MSI, a novel framework for histology-based MSI prediction that incorporates the Dilated Neighborhood Attention Transformer (DiNAT). This model enhances global context recognition and substantially expands receptive fields, all without additional computational burden. Our results demonstrate that DiNAT-MSI achieves a superior patientwise AUROC compared to ResNet18 and Swin Transformer, along with commendable explainability. Our work not only illustrates a more accessible diagnostic tool for leveraging histological data but also underscores the potential of Transformerbased models with sophisticated attention designs in advancing precision medicine for colorectal cancer patients.
Authors
- Yun‐Chi Chen (ORCID: https://orcid.org/0000-0003-2787-1247)
- Ta‐Chung Chao (ORCID: https://orcid.org/0000-0003-1451-1939)
- Yi‐Hsien Hsieh (ORCID: https://orcid.org/0000-0003-4942-1888)
- Tzu-Yu Sun
- Huaizhi Wang (ORCID: https://orcid.org/0000-0001-5458-9154)
- Che Lin (ORCID: https://orcid.org/0000-0002-4986-311X)
- Le‐Yin Hsu (ORCID: https://orcid.org/0000-0002-4552-5471)
- Wimaya Nitya Phandita
Institutions
- National Taiwan University of Science and Technology (TW)
- National Taiwan University (TW)
- Taipei Institute of Pathology (TW)
- National Taipei University (TW)
Publication Details
- Published
- 2024-11-27
- DOI
- https://doi.org/10.1109/bibe63649.2024.10820458
- Citations
- 1
- Primary Topic
- Radiomics and Machine Learning in Medical Imaging
- Type
- article
- Field-Weighted Citation Impact
- 0.40