Predicting Single-Cell Spatial Gene Expression from H&E using Pathology Foundation Models
Predicting gene expression directly from hematoxylin and eosin (H&E) images offers a scalable and cost-effective approach to deriving spatial molecular insights from routine histology. Pathology foundation models, typically pretrained using tile-level objectives, may not adequately capture the fine-grained cellular features required for single-cell molecular prediction. In this work, we systematically evaluate and establish domain-informed and task-specific strategies for adapting pathology foundation models to single-cell spatial gene expression prediction. Using paired H&E and Xenium 5K data, our approach improves mean gene-wise Pearson correlation by 2.67x over the standard zero-shot baseline and achieves state-of-the-art performance on this task. We demonstrate strong gene-detection performance across the full gene panel (AUROC = 0.800) and importantly identify that predictive performance varies substantially across biological contexts, with our model achieving its highest Pearson correlation for spatially variable genes (r = 0.643). Our findings demonstrate that, despite the challenges of sparse single-cell measurements, H&E-derived representations can recover biologically meaningful spatial expression patterns, highlighting both the opportunities and limitations of morphology-based molecular inference at cellular resolution.
Authors
- Evan Liu (ORCID: https://orcid.org/0009-0002-2513-2774)
- Hassaan Maan (ORCID: https://orcid.org/0000-0002-3830-7177)
- Runmin Wei (ORCID: https://orcid.org/0000-0001-7707-0160)
- Bob Chen (ORCID: https://orcid.org/0000-0003-1508-1758)
- Elisa Penna (ORCID: https://orcid.org/0000-0001-7057-3566)
- Lisa M. McGinnis (ORCID: https://orcid.org/0000-0002-8532-9264)
- Kenneth T. Gao (ORCID: https://orcid.org/0000-0002-5975-0127)
- Ashley P. Tsang (ORCID: https://orcid.org/0000-0002-0174-6360)
- Aïcha BenTaieb (ORCID: https://orcid.org/0000-0002-7899-3327)
- Conrad Foo (ORCID: https://orcid.org/0000-0002-1333-3678)
- Veronica Ibarra Lopez
- Hector Corrada Bravo
- Donny Chan
Publication Details
- Journal
- arXiv (Cornell University)
- Published
- 2026-11-10
- DOI
- https://doi.org/10.48550/arxiv.2611.13649
- Primary Topic
- Single-cell and spatial transcriptomics
- Type
- preprint