A self-interpretable deep learning network for early prediction of pathologic complete response to neoadjuvant chemotherapy based on breast pre-treatment dynamic contrast-enhanced magnetic resonance imaging

Accurate prediction of pathologic complete response to neoadjuvant chemotherapy non-invasively before treatment via dynamic contrast-enhanced magnetic resonance imaging is vital for developing a personalized therapy strategy. However, the application of deep learning in this domain is characterized by its black-box nature, largely relying on post-hoc analysis to interpret final decision-making. This reliance results in a lack of self-interpretability in the operational mechanisms of feature extraction, feature fusion, and decision-making. Moreover, these models have demonstrated unsatisfactory prediction performance due to insufficient feature modeling. To address these issues, we propose a self-interpretable deep learning network that can provide the intrinsic interpretability of feature extraction, multi-scale feature fusion, and final prediction. First, the interpretable perception module is designed to extract features both effectively and interpretably. Furthermore, the interpretable adaptive multi-scale feature fusion module is proposed to fuse multi-scale features. Finally, an end-to-end self-interpretable deep learning network is presented to predict pathologic complete response with self-interpretability. Validated on a multi-center pre-treatment dynamic contrast-enhanced magnetic resonance imaging dataset, our self-interpretable deep learning network outperforms state-of-the-art methods in both prediction performance and self-interpretability, improving the area under the receiver operating characteristic curve by at least 4.81% while providing both qualitative and quantitative self-interpretability. Our study demonstrates that our proposed self-interpretable deep learning network can extract key information from pre-treatment breast dynamic contrast-enhanced magnetic resonance imaging while enhancing both the prediction performance and the transparency of the model, thereby improving its trustworthiness in clinical settings. • IPM improves the self-interpretability of feature extraction process. • IFFM adaptively interprets the process of multi-scale feature fusion. • Our SIDLN provides precise and self-interpretable pCR prediction to NAC. • The interpretability of SIDLN surpasses that of the existing post-hoc methods. • Our methods enhance the trustworthiness of decision-making in medicine.

Authors

Institutions

Publication Details

Journal
Engineering Applications of Artificial Intelligence
Published
2024-10-11
DOI
https://doi.org/10.1016/j.engappai.2024.109431
Citations
5
Primary Topic
MRI in cancer diagnosis
Type
article
Field-Weighted Citation Impact
2.02

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A self-interpretable deep learning network for early prediction of pathologic complete response to neoadjuvant chemotherapy based on breast pre-treatment dynamic contrast-enhanced magnetic resonance imaging

Hui Zeng, Da‐Wei Ding, Yu Gao
5 citations
Engineering Applications of Artificial Intelligence
MRI in cancer diagnosis
2.02
article

A self-interpretable deep learning network for early prediction of pathologic complete response to neoadjuvant chemotherapy based on breast pre-treatment dynamic contrast-enhanced magnetic resonance imaging

Hui Zeng, Da‐Wei Ding, Yu Gao
article en
5 citations

Abstract

Accurate prediction of pathologic complete response to neoadjuvant chemotherapy non-invasively before treatment via dynamic contrast-enhanced magnetic resonance imaging is vital for developing a personalized therapy strategy. However, the application of deep learning in this domain is characterized by its black-box nature, largely relying on post-hoc analysis to interpret final decision-making. This reliance results in a lack of self-interpretability in the operational mechanisms of feature extraction, feature fusion, and decision-making. Moreover, these models have demonstrated unsatisfactory prediction performance due to insufficient feature modeling. To address these issues, we propose a self-interpretable deep learning network that can provide the intrinsic interpretability of feature extraction, multi-scale feature fusion, and final prediction. First, the interpretable perception module is designed to extract features both effectively and interpretably. Furthermore, the interpretable adaptive multi-scale feature fusion module is proposed to fuse multi-scale features. Finally, an end-to-end self-interpretable deep learning network is presented to predict pathologic complete response with self-interpretability. Validated on a multi-center pre-treatment dynamic contrast-enhanced magnetic resonance imaging dataset, our self-interpretable deep learning network outperforms state-of-the-art methods in both prediction performance and self-interpretability, improving the area under the receiver operating characteristic curve by at least 4.81% while providing both qualitative and quantitative self-interpretability. Our study demonstrates that our proposed self-interpretable deep learning network can extract key information from pre-treatment breast dynamic contrast-enhanced magnetic resonance imaging while enhancing both the prediction performance and the transparency of the model, thereby improving its trustworthiness in clinical settings. • IPM improves the self-interpretability of feature extraction process. • IFFM adaptively interprets the process of multi-scale feature fusion. • Our SIDLN provides precise and self-interpretable pCR prediction to NAC. • The interpretability of SIDLN surpasses that of the existing post-hoc methods. • Our methods enhance the trustworthiness of decision-making in medicine.

Engineering Applications of Artificial IntelligenceVol. 138
University of Science and Technology Beijing (CN)
National Natural Science Foundation of China
Openalex Percentile: Top 13%
MRI in cancer diagnosis
2.02
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.