Robust multi-modal fusion architecture for medical data with knowledge distillation
This innovative multi-modal fusion architecture has demonstrated robustness to missing modalities, and has shown excellent performance in fusing three medical modalities for patient outcome prediction. This study provides a novel idea for addressing the challenge of missing modalities and has the potential be scaled to additional modalities.
Authors
- Shiyu Fan (ORCID: https://orcid.org/0000-0002-7857-0148)
- Muyu Wang (ORCID: https://orcid.org/0000-0002-1606-5058)
- Hui Chen (ORCID: https://orcid.org/0000-0002-0048-0193)
- Binyu Gao
- Yichen Li (ORCID: https://orcid.org/0000-0002-4326-6285)
- Z. P. Xie (ORCID: https://orcid.org/0009-0006-1698-1060)
Institutions
- Beijing YouAn Hospital (CN)
Publication Details
- Journal
- Computer Methods and Programs in Biomedicine
- Published
- 2024-12-18
- DOI
- https://doi.org/10.1016/j.cmpb.2024.108568
- Citations
- 8
- Primary Topic
- AI in cancer detection
- Type
- article
- Field-Weighted Citation Impact
- 2.78
Funders
- National Natural Science Foundation of China
- Natural Science Foundation of Beijing Municipality