Vision-Language Models in Medical Imaging: Transforming AI-Assisted Healthcare

Vision-language models (VLMs) are creating new opportunitiesfor medical image interpretation by connecting visualrepresentations with clinical language. Unlike conventional taskspecificmodels, these systems can support multiple applications,including disease classification, medical visual question answering,image-text retrieval, semantic segmentation, and radiology reportgeneration. However, their effectiveness depends on the qualityof paired image-text data, the adaptation strategy, the imagingmodality, and the evaluation method. This paper presents acomparative literature review of five research studies coveringconcept-based classification, multimodal pre-training, ultrasoundadaptation, and retrieval-assisted in-context learning. The reviewedapproaches demonstrate different advantages: trainingfreemodels reduce the need for retraining, physics-informedadapters improve ultrasound analysis, and joint vision-languagearchitectures support cross-modal reasoning. The literaturealso reveals limitations involving data scarcity, modality shifts,computational requirements, clinical factuality, and generalizationacross patients and institutions. The review identifies researchopportunities in three-dimensional medical imaging, clinicallygrounded report evaluation, probabilistic concept representations,and robust cross-domain adaptation. The findings suggest thatsuccessful clinical deployment requires not only improved modelperformance but also reliable validation, interpretability, andhuman oversight.

Authors

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-10-27
DOI
https://doi.org/10.5281/zenodo.23682666
Primary Topic
Multimodal Machine Learning Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Vision-Language Models in Medical Imaging: Transforming AI-Assisted Healthcare

Samruddhi Phadtare Samruddhi
4 links
Zenodo (CERN European Organization for Nuclear Research)
Multimodal Machine Learning Applications
article

Vision-Language Models in Medical Imaging: Transforming AI-Assisted Healthcare

Samruddhi Phadtare Samruddhi
article en

Abstract

Vision-language models (VLMs) are creating new opportunitiesfor medical image interpretation by connecting visualrepresentations with clinical language. Unlike conventional taskspecificmodels, these systems can support multiple applications,including disease classification, medical visual question answering,image-text retrieval, semantic segmentation, and radiology reportgeneration. However, their effectiveness depends on the qualityof paired image-text data, the adaptation strategy, the imagingmodality, and the evaluation method. This paper presents acomparative literature review of five research studies coveringconcept-based classification, multimodal pre-training, ultrasoundadaptation, and retrieval-assisted in-context learning. The reviewedapproaches demonstrate different advantages: trainingfreemodels reduce the need for retraining, physics-informedadapters improve ultrasound analysis, and joint vision-languagearchitectures support cross-modal reasoning. The literaturealso reveals limitations involving data scarcity, modality shifts,computational requirements, clinical factuality, and generalizationacross patients and institutions. The review identifies researchopportunities in three-dimensional medical imaging, clinicallygrounded report evaluation, probabilistic concept representations,and robust cross-domain adaptation. The findings suggest thatsuccessful clinical deployment requires not only improved modelperformance but also reliable validation, interpretability, andhuman oversight.

Zenodo (CERN European Organization for Nuclear Research)
Shivnagar Vidya Prasarak Mandal Institute of Technology and Engineering (IN)
Good health and well-being
Openalex Percentile: Top 17%
Multimodal Machine Learning Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon