Genome-anchored foundation model embeddings improve molecular prediction from histology images

Precision oncology requires accurate molecular insights, yet obtaining these directly from genomics is costly and time-consuming for broad clinical use. Predicting complex molecular features and patient prognosis directly from routine whole-slide images (WSIs) remains a major challenge for current deep learning methods. Here we introduce PathLUPI, which uses transcriptomic privileged information during training to extract genome-anchored histological embeddings, enabling effective molecular prediction using only WSIs at inference. Through extensive evaluation across 49 molecular oncology tasks using 11,361 cases from 20 cohorts, PathLUPI demonstrates superior performance compared to conventional methods trained solely on WSIs. Crucially, it achieves an area under the receiver operating characteristic curve of at least 0.80 across 18 biomarker prediction and molecular subtyping tasks, and a concordance index of at least 0.70 across survival cohorts spanning five major cancer types. Moreover, PathLUPI embeddings reveal distinct cellular morphological signatures associated with specific genotypes, whose spatial fidelity is substantiated in representative high-resolution spatial transcriptomics samples. By effectively encoding molecular context to refine WSI representations, PathLUPI offers a strategy to bridge molecular insights with routine pathology workflows for wider clinical application. Obtaining accurate molecular insights for precision oncology remains costly and time consuming. Here, the authors develop PathLUPI, a deep learning method to enable effective molecular prediction in cancer using only routine whole-slide images, with evaluation across 49 molecular oncology tasks in 20 different cohorts.

Authors

Institutions

Publication Details

Journal
Nature Communications
Published
2026-11-02
DOI
https://doi.org/10.1038/s41467-026-78947-2
Primary Topic
AI in cancer detection
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Genome-anchored foundation model embeddings improve molecular prediction from histology images

Ronald Chan, Jing Zhang, Zhiguo Hé, Jiabo Ma et al.
4 links
Nature Communications
AI in cancer detection
article

Genome-anchored foundation model embeddings improve molecular prediction from histology images

Ronald Chan, Jing Zhang, Zhiguo Hé, Jiabo Ma, Fengtao Zhou, Yunfang Yu, Herui Yao, Yingxue Xu, Yihui Wang, Luyang Luo, Hao Jiang, Hua-Jun Zhou, Hao Chen, Xiuming Zhang, Luhui Mao
article en

Abstract

Precision oncology requires accurate molecular insights, yet obtaining these directly from genomics is costly and time-consuming for broad clinical use. Predicting complex molecular features and patient prognosis directly from routine whole-slide images (WSIs) remains a major challenge for current deep learning methods. Here we introduce PathLUPI, which uses transcriptomic privileged information during training to extract genome-anchored histological embeddings, enabling effective molecular prediction using only WSIs at inference. Through extensive evaluation across 49 molecular oncology tasks using 11,361 cases from 20 cohorts, PathLUPI demonstrates superior performance compared to conventional methods trained solely on WSIs. Crucially, it achieves an area under the receiver operating characteristic curve of at least 0.80 across 18 biomarker prediction and molecular subtyping tasks, and a concordance index of at least 0.70 across survival cohorts spanning five major cancer types. Moreover, PathLUPI embeddings reveal distinct cellular morphological signatures associated with specific genotypes, whose spatial fidelity is substantiated in representative high-resolution spatial transcriptomics samples. By effectively encoding molecular context to refine WSI representations, PathLUPI offers a strategy to bridge molecular insights with routine pathology workflows for wider clinical application. Obtaining accurate molecular insights for precision oncology remains costly and time consuming. Here, the authors develop PathLUPI, a deep learning method to enable effective molecular prediction in cancer using only routine whole-slide images, with evaluation across 49 molecular oncology tasks in 20 different cohorts.

Nature Communications
Macau University of Science and Technology (MO), Harvard University (US), Sun Yat-sen University (CN), Jinan University (CN), Chinese University of Hong Kong (HK), Hong Kong University of Science and Technology (HK), HKUST Shenzhen Research Institute (CN), Sun Yat-sen Memorial Hospital (CN), First Affiliated Hospital of Jinan University (CN), First Affiliated Hospital Zhejiang University (CN), Zhejiang University (CN)
Good health and well-being
Openalex Percentile: Top 99%
AI in cancer detection
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon