Multi-View Synergistic Learning with Vision-Language Adaptation for Low-Resource Biomedical Image Classification

Accurate biomedical image classification under limited supervision remains challenging due to scarce annotations, subtle inter-class differences, and complex disease semantics. Pretrained vision-language models offer a promising foundation for alleviating data scarcity through knowledge transfer, yet effectively adapting them to low-resource biomedical tasks remains nontrivial. To this end, we propose Multi-View Synergistic Learning (MVSL), a unified framework that jointly considers three complementary perspectives: adaptation paradigms, representation granularity, and disease semantic relationships. Specifically, MVSL adopts tailored adaptation strategies for visual and textual encoders, accommodating their distinct representational characteristics while preserving pretrained knowledge. To capture both holistic image semantics and localized pathological evidence, we introduce multi-granularity contrastive learning that aligns global image representations and local visual features with disease-specific textual embeddings. Furthermore, we develop a Disease Semantic Graph (DSG) that leverages disease descriptions generated by large language models to model class-level semantic relationships and regularize adapted textual representations, thereby complementing discriminative learning and helping mitigate excessive specialization toward observed categories. Through the synergy of these complementary perspectives, MVSL enhances fine-grained discrimination while supporting semantic consistency and generalization to unseen categories. Extensive experiments on 11 public biomedical datasets spanning 9 imaging modalities and 10 anatomical regions demonstrate the effectiveness of MVSL in few-shot classification and base-to-novel generalization. The implementation and detailed experimental results are publicly available at https://github.com/luoxiaoliu/MVSL.

Authors

Institutions

Publication Details

Journal
IEEE Transactions on Image Processing
Published
2026-11-17
DOI
https://doi.org/10.1109/tip.2026.3753085
Citations
2
Primary Topic
Domain Adaptation and Few-Shot Learning
Type
article
Field-Weighted Citation Impact
2.12
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Multi-View Synergistic Learning with Vision-Language Adaptation for Low-Resource Biomedical Image Classification

Xiaoliu Luo, Huiqing Qi, Xu Wang, Ting Xie et al.
2 citations
IEEE Transactions on Image Processing
Domain Adaptation and Few-Shot Learning
2.12
article

Multi-View Synergistic Learning with Vision-Language Adaptation for Low-Resource Biomedical Image Classification

Xiaoliu Luo, Huiqing Qi, Xu Wang, Ting Xie, Mengzhu Wang, Joey Tianyi Zhou, Taiping Zhang, Minxue Xiao
article en
2 citations

Abstract

Accurate biomedical image classification under limited supervision remains challenging due to scarce annotations, subtle inter-class differences, and complex disease semantics. Pretrained vision-language models offer a promising foundation for alleviating data scarcity through knowledge transfer, yet effectively adapting them to low-resource biomedical tasks remains nontrivial. To this end, we propose Multi-View Synergistic Learning (MVSL), a unified framework that jointly considers three complementary perspectives: adaptation paradigms, representation granularity, and disease semantic relationships. Specifically, MVSL adopts tailored adaptation strategies for visual and textual encoders, accommodating their distinct representational characteristics while preserving pretrained knowledge. To capture both holistic image semantics and localized pathological evidence, we introduce multi-granularity contrastive learning that aligns global image representations and local visual features with disease-specific textual embeddings. Furthermore, we develop a Disease Semantic Graph (DSG) that leverages disease descriptions generated by large language models to model class-level semantic relationships and regularize adapted textual representations, thereby complementing discriminative learning and helping mitigate excessive specialization toward observed categories. Through the synergy of these complementary perspectives, MVSL enhances fine-grained discrimination while supporting semantic consistency and generalization to unseen categories. Extensive experiments on 11 public biomedical datasets spanning 9 imaging modalities and 10 anatomical regions demonstrate the effectiveness of MVSL in few-shot classification and base-to-novel generalization. The implementation and detailed experimental results are publicly available at https://github.com/luoxiaoliu/MVSL.

IEEE Transactions on Image ProcessingVol. PP
Agency for Science, Technology and Research (SG), Chongqing University (CN), National University of Singapore (SG), Hebei University of Technology (CN), Chongqing University of Technology (CN), Singapore Management University (SG)
Good health and well-being
Openalex Percentile: Top 12%
Domain Adaptation and Few-Shot Learning
2.12
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon