LG-MIL: Language-Guided Multiple Instance Learning for Coordinate-Aligned Attention Analysis in Whole-Slide Images

Language-Guided Multiple Instance Learning (LG-MIL) is introduced as a weakly supervised framework for whole-slide image (WSI) analysis. The proposed approach integrates visual and textual information to support interpretable slide-level prediction. Patch-level features extracted from WSIs are combined with class-level textual prompts encoded in a shared multimodal space. To enable semantically informed aggregation under weak supervision, text embeddings guide patch weighting through a cross-modal attention mechanism. A coordinate retrofit strategy is further employed to recover per-patch (x,y) locations at inference, enabling the generation of attention heatmaps, top-K tile visualizations, and saliency-based summaries for spatial interpretability. To regulate the sharpness and semantic alignment of attention distributions, the framework incorporates two interpretable controls: the attention temperature τ(tau) and the contrastive loss weight α. Experiments on patient-exclusive validation and test splits demonstrate competitive slide-level classification performance, with measurable variation across random initializations and hyperparameter settings. Saliency analyses further investigate the relationship between model confidence and attention dispersion, while ablation studies show that attention temperature influences both attention concentration and predictive performance. Lower temperature values produce more concentrated attention distributions, whereas higher values result in more diffuse attention patterns. Overall, LG-MIL provides a reproducible pipeline for language-guided, coordinate-aligned attention analysis in WSIs, enabling transparent investigation of model behavior under weak supervision. The framework highlights the potential of text guidance, spatial alignment, and saliency quantification for advancing interpretability in large-scale WSI modeling without requiring dense or clinical annotations.

Authors

Institutions

Publication Details

Journal
Research Square
Published
2026-11-19
DOI
https://doi.org/10.21203/rs.3.rs-11763838/v1
Primary Topic
AI in cancer detection
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

LG-MIL: Language-Guided Multiple Instance Learning for Coordinate-Aligned Attention Analysis in Whole-Slide Images

Md. Rezaul Bashar, Mohammad Mehedi Hassan
Research Square
AI in cancer detection
preprint

LG-MIL: Language-Guided Multiple Instance Learning for Coordinate-Aligned Attention Analysis in Whole-Slide Images

Md. Rezaul Bashar, Mohammad Mehedi Hassan
preprint en

Abstract

Language-Guided Multiple Instance Learning (LG-MIL) is introduced as a weakly supervised framework for whole-slide image (WSI) analysis. The proposed approach integrates visual and textual information to support interpretable slide-level prediction. Patch-level features extracted from WSIs are combined with class-level textual prompts encoded in a shared multimodal space. To enable semantically informed aggregation under weak supervision, text embeddings guide patch weighting through a cross-modal attention mechanism. A coordinate retrofit strategy is further employed to recover per-patch (x,y) locations at inference, enabling the generation of attention heatmaps, top-K tile visualizations, and saliency-based summaries for spatial interpretability. To regulate the sharpness and semantic alignment of attention distributions, the framework incorporates two interpretable controls: the attention temperature τ(tau) and the contrastive loss weight α. Experiments on patient-exclusive validation and test splits demonstrate competitive slide-level classification performance, with measurable variation across random initializations and hyperparameter settings. Saliency analyses further investigate the relationship between model confidence and attention dispersion, while ablation studies show that attention temperature influences both attention concentration and predictive performance. Lower temperature values produce more concentrated attention distributions, whereas higher values result in more diffuse attention patterns. Overall, LG-MIL provides a reproducible pipeline for language-guided, coordinate-aligned attention analysis in WSIs, enabling transparent investigation of model behavior under weak supervision. The framework highlights the potential of text guidance, spatial alignment, and saliency quantification for advancing interpretability in large-scale WSI modeling without requiring dense or clinical annotations.

Research Square
Kyoto College of Graduate Studies for Informatics (JP), Western Sydney University (AU)
AI in cancer detection
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon