Multimodal Healthcare Foundation Models: Techniques, Challenges, and Opportunities

With the rapid advance of multimodal foundation models, multimodal healthcare foundation models (MHFMs) are increasingly being adopted for reliable, intelligent clinical applications. They promise to advance precision medicine, streamline clinical workflows, and ultimately improve patient outcomes. Yet the healthcare domain imposes stringent requirements, including accuracy, safety, transparency, and trustworthiness, that demand techniques beyond those used for general-purpose multimodal foundation models. However, existing surveys largely take application-centric or data-oriented views and often underplay the technical underpinnings and domain-specific adaptations. To fill this gap, this survey explores and summarizes MHFMs from a technical perspective. Specifically, we provide a systematical taxonomy of MHFMs based on their methodologies, summarizing multimodal foundation model techniques that are applicable to the healthcare domain. In addition, we synthesize the key challenges and opportunities for deploying MHFMs in real-world healthcare settings, providing a roadmap for future research.

Authors

Institutions

Publication Details

Journal
ACM Computing Surveys
Published
2026-11-16
DOI
https://doi.org/10.1145/3863944
Primary Topic
Multimodal Machine Learning Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Multimodal Healthcare Foundation Models: Techniques, Challenges, and Opportunities

Ciyuan Peng, Shuo Yu, Jing Fei Ren, Lianhua Chi et al.
1 links
ACM Computing Surveys
Multimodal Machine Learning Applications
article

Multimodal Healthcare Foundation Models: Techniques, Challenges, and Opportunities

Ciyuan Peng, Shuo Yu, Jing Fei Ren, Lianhua Chi, Mujie Liu, Ibrahim Khalil, Feng Xia, Shan Jin
article en

Abstract

With the rapid advance of multimodal foundation models, multimodal healthcare foundation models (MHFMs) are increasingly being adopted for reliable, intelligent clinical applications. They promise to advance precision medicine, streamline clinical workflows, and ultimately improve patient outcomes. Yet the healthcare domain imposes stringent requirements, including accuracy, safety, transparency, and trustworthiness, that demand techniques beyond those used for general-purpose multimodal foundation models. However, existing surveys largely take application-centric or data-oriented views and often underplay the technical underpinnings and domain-specific adaptations. To fill this gap, this survey explores and summarizes MHFMs from a technical perspective. Specifically, we provide a systematical taxonomy of MHFMs based on their methodologies, summarizing multimodal foundation model techniques that are applicable to the healthcare domain. In addition, we synthesize the key challenges and opportunities for deploying MHFMs in real-world healthcare settings, providing a roadmap for future research.

ACM Computing Surveys
La Trobe University (AU), Dalian University of Technology (CN), Chengdu University of Technology (CN), RMIT University (AU)
Good health and well-being
Multimodal Machine Learning Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon