Multimodal Healthcare Foundation Models: Techniques, Challenges, and Opportunities
With the rapid advance of multimodal foundation models, multimodal healthcare foundation models (MHFMs) are increasingly being adopted for reliable, intelligent clinical applications. They promise to advance precision medicine, streamline clinical workflows, and ultimately improve patient outcomes. Yet the healthcare domain imposes stringent requirements, including accuracy, safety, transparency, and trustworthiness, that demand techniques beyond those used for general-purpose multimodal foundation models. However, existing surveys largely take application-centric or data-oriented views and often underplay the technical underpinnings and domain-specific adaptations. To fill this gap, this survey explores and summarizes MHFMs from a technical perspective. Specifically, we provide a systematical taxonomy of MHFMs based on their methodologies, summarizing multimodal foundation model techniques that are applicable to the healthcare domain. In addition, we synthesize the key challenges and opportunities for deploying MHFMs in real-world healthcare settings, providing a roadmap for future research.
Authors
- Ciyuan Peng (ORCID: https://orcid.org/0000-0002-3580-5402)
- Shuo Yu (ORCID: https://orcid.org/0000-0003-1124-9509)
- Jing Fei Ren (ORCID: https://orcid.org/0000-0003-0169-1491)
- Lianhua Chi (ORCID: https://orcid.org/0000-0002-6851-0731)
- Mujie Liu (ORCID: https://orcid.org/0009-0002-0879-7168)
- Ibrahim Khalil (ORCID: https://orcid.org/0000-0001-5512-114X)
- Feng Xia (ORCID: https://orcid.org/0000-0002-8324-1859)
- Shan Jin (ORCID: https://orcid.org/0000-0003-2544-0531)
Institutions
- La Trobe University (AU)
- Dalian University of Technology (CN)
- Chengdu University of Technology (CN)
- RMIT University (AU)
Publication Details
- Journal
- ACM Computing Surveys
- Published
- 2026-11-16
- DOI
- https://doi.org/10.1145/3863944
- Primary Topic
- Multimodal Machine Learning Applications
- Type
- article
- Field-Weighted Citation Impact
- 0.00