Genome-anchored foundation model embeddings improve molecular prediction from histology images
Precision oncology requires accurate molecular insights, yet obtaining these directly from genomics is costly and time-consuming for broad clinical use. Predicting complex molecular features and patient prognosis directly from routine whole-slide images (WSIs) remains a major challenge for current deep learning methods. Here we introduce PathLUPI, which uses transcriptomic privileged information during training to extract genome-anchored histological embeddings, enabling effective molecular prediction using only WSIs at inference. Through extensive evaluation across 49 molecular oncology tasks using 11,361 cases from 20 cohorts, PathLUPI demonstrates superior performance compared to conventional methods trained solely on WSIs. Crucially, it achieves an area under the receiver operating characteristic curve of at least 0.80 across 18 biomarker prediction and molecular subtyping tasks, and a concordance index of at least 0.70 across survival cohorts spanning five major cancer types. Moreover, PathLUPI embeddings reveal distinct cellular morphological signatures associated with specific genotypes, whose spatial fidelity is substantiated in representative high-resolution spatial transcriptomics samples. By effectively encoding molecular context to refine WSI representations, PathLUPI offers a strategy to bridge molecular insights with routine pathology workflows for wider clinical application. Obtaining accurate molecular insights for precision oncology remains costly and time consuming. Here, the authors develop PathLUPI, a deep learning method to enable effective molecular prediction in cancer using only routine whole-slide images, with evaluation across 49 molecular oncology tasks in 20 different cohorts.
Authors
- Ronald Chan (ORCID: https://orcid.org/0000-0001-9267-0076)
- Jing Zhang (ORCID: https://orcid.org/0000-0003-3555-0216)
- Zhiguo Hé (ORCID: https://orcid.org/0000-0001-5153-617X)
- Jiabo Ma (ORCID: https://orcid.org/0000-0001-8532-4466)
- Fengtao Zhou (ORCID: https://orcid.org/0000-0001-7039-1156)
- Yunfang Yu (ORCID: https://orcid.org/0000-0003-2579-6220)
- Herui Yao (ORCID: https://orcid.org/0000-0001-5520-6469)
- Yingxue Xu (ORCID: https://orcid.org/0000-0002-9657-3107)
- Yihui Wang (ORCID: https://orcid.org/0000-0001-7186-7814)
- Luyang Luo (ORCID: https://orcid.org/0000-0002-7485-4151)
- Hao Jiang (ORCID: https://orcid.org/0000-0002-0270-5165)
- Hua-Jun Zhou
- Hao Chen (ORCID: https://orcid.org/0000-0002-7575-3061)
- Xiuming Zhang (ORCID: https://orcid.org/0000-0002-0457-5296)
- Luhui Mao
Institutions
- Macau University of Science and Technology (MO)
- Harvard University (US)
- Sun Yat-sen University (CN)
- Jinan University (CN)
- Chinese University of Hong Kong (HK)
- Hong Kong University of Science and Technology (HK)
- HKUST Shenzhen Research Institute (CN)
- Sun Yat-sen Memorial Hospital (CN)
- First Affiliated Hospital of Jinan University (CN)
- First Affiliated Hospital Zhejiang University (CN)
- Zhejiang University (CN)
Publication Details
- Journal
- Nature Communications
- Published
- 2026-11-02
- DOI
- https://doi.org/10.1038/s41467-026-78947-2
- Primary Topic
- AI in cancer detection
- Type
- article
- Field-Weighted Citation Impact
- 0.00