Explainable multimodal fusion for breast carcinoma diagnosis: A systematic review, open problems, and future directions

Breast carcinoma (BC) remains one of the most common and lethal malignancies in women worldwide, making an early and accurate diagnosis a public health priority. Recent artificial intelligence (AI) research has increasingly explored multimodal fusion, with imaging, clinical records, histopathology, and genomic data to produce richer, more reliable predictions. In parallel, explainable AI (XAI) techniques aim to address a key barrier to clinical use: transparency about how deep learning models make decisions. This systematic review examines 49 peer-reviewed studies published between 2015 and 2025, following the PRISMA guidelines to analyze the landscape of multimodal learning and XAI in the diagnosis and prognosis of BC. We categorize reported fusion strategies from simple feature concatenation to advanced attention-based, gated, and hybrid architectures, designed to manage data heterogeneity and missing modalities. We also document model designs, including transfer learning, transformers, graph neural networks (GNNs), autoencoders, and ensembles, supported by preprocessing methods like stain normalization and GAN-based augmentation, and the use of XAI techniques: Grad-CAM, SHAP, and attention weights, which help bridge the gap between complex AI systems and clinical workflows. Across included studies, multimodal models often outperformed unimodal baselines; however, effect sizes varied by dataset, validation design (cross-validation versus external), and the handling of missing modalities. Our review highlights persistent open problems, including the limited availability of multimodal datasets, inconsistent benchmarks, and the scarcity of interpretable models in real world settings. Future research on BC care should focus on developing ensemble-based fusion approaches, validating them in various clinics, and embedding clinician expertise. All of which are crucial for developing AI systems that are accurate, transparent, generalizable, and trustworthy.

Authors

Institutions

Publication Details

Journal
Computer Methods and Programs in Biomedicine
Published
2025-11-07
DOI
https://doi.org/10.1016/j.cmpb.2025.109152
Primary Topic
AI in cancer detection
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Explainable multimodal fusion for breast carcinoma diagnosis: A systematic review, open problems, and future directions

Sahil Garg, Nurul Choudhury, Giancarlo Fortino, Anika Tahsin et al.
Computer Methods and Programs in Biomedicine
AI in cancer detection
article

Explainable multimodal fusion for breast carcinoma diagnosis: A systematic review, open problems, and future directions

Sahil Garg, Nurul Choudhury, Giancarlo Fortino, Anika Tahsin, Md. Zia Uddin, Md. Golam Rabiul Alam, Mohammad Mehedi Hassan, Deema Alzamil
article en

Abstract

Breast carcinoma (BC) remains one of the most common and lethal malignancies in women worldwide, making an early and accurate diagnosis a public health priority. Recent artificial intelligence (AI) research has increasingly explored multimodal fusion, with imaging, clinical records, histopathology, and genomic data to produce richer, more reliable predictions. In parallel, explainable AI (XAI) techniques aim to address a key barrier to clinical use: transparency about how deep learning models make decisions. This systematic review examines 49 peer-reviewed studies published between 2015 and 2025, following the PRISMA guidelines to analyze the landscape of multimodal learning and XAI in the diagnosis and prognosis of BC. We categorize reported fusion strategies from simple feature concatenation to advanced attention-based, gated, and hybrid architectures, designed to manage data heterogeneity and missing modalities. We also document model designs, including transfer learning, transformers, graph neural networks (GNNs), autoencoders, and ensembles, supported by preprocessing methods like stain normalization and GAN-based augmentation, and the use of XAI techniques: Grad-CAM, SHAP, and attention weights, which help bridge the gap between complex AI systems and clinical workflows. Across included studies, multimodal models often outperformed unimodal baselines; however, effect sizes varied by dataset, validation design (cross-validation versus external), and the handling of missing modalities. Our review highlights persistent open problems, including the limited availability of multimodal datasets, inconsistent benchmarks, and the scarcity of interpretable models in real world settings. Future research on BC care should focus on developing ensemble-based fusion approaches, validating them in various clinics, and embedding clinician expertise. All of which are crucial for developing AI systems that are accurate, transparent, generalizable, and trustworthy.

Computer Methods and Programs in BiomedicineVol. 274
SINTEF (NO), Canadian University of Dubai (AE), King Saud University (SA), University of Calabria (IT), BRAC University (BD)
Openalex Percentile: Top 83%
AI in cancer detection
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.