AI in Cancer Prognosis: A Systematic Review of Multimodal Models Combining Pathology Images and High-Throughput Omics

This study systematically reviews and evaluates published research on machine learning models that integrate histopathology whole slide images and high-throughput -omic data to predict overall survival in cancer. A comprehensive search of PubMed, EMBASE, and Cochrane CENTRAL was conducted through August 12, 2024, with citation screening for additional studies. Eligible studies applied machine learning or deep learning methods to multimodal data combining pathology images and -omics. Data extraction followed the CHARMS checklist, and risk of bias was assessed using the PROBAST + AI tool. Narrative synthesis was conducted in line with PRISMA 2020 guidelines. Forty-eight studies published since 2017 met inclusion criteria, spanning 19 cancer types. All relied on The Cancer Genome Atlas dataset. Modelling approaches included regularised Cox regression (n = 4), classical machine learning (n = 13), and deep learning (n = 31). Reported concordance indices ranged from 0.550 to 0.857, with most multimodal models outperforming unimodal counterparts. However, all studies were assessed as having high or unclear risk of bias—most often due to limited external validation, insufficient reporting, and minimal assessment of clinical utility. This review highlights a rapidly evolving yet methodologically underdeveloped field. While model performance is promising, improvements in data standardisation, reporting practices, and real-world contextualisation are critical for clinical translation. This work was funded by the National Pathology Imaging Cooperative (NPIC), supported by UK Research and Innovation (Project no. 104687).

Authors

Institutions

Publication Details

Journal
Cancer Informatics
Published
2026-05-01
DOI
https://doi.org/10.1177/11769351261434523
Primary Topic
AI in cancer detection
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

AI in Cancer Prognosis: A Systematic Review of Multimodal Models Combining Pathology Images and High-Throughput Omics

Andrew Broad, Darren Treanor, Charlotte Jennings, David Westhead et al.
Cancer Informatics
AI in cancer detection
article

AI in Cancer Prognosis: A Systematic Review of Multimodal Models Combining Pathology Images and High-Throughput Omics

Andrew Broad, Darren Treanor, Charlotte Jennings, David Westhead, Emily Clarke, Lucy Godson
article en

Abstract

This study systematically reviews and evaluates published research on machine learning models that integrate histopathology whole slide images and high-throughput -omic data to predict overall survival in cancer. A comprehensive search of PubMed, EMBASE, and Cochrane CENTRAL was conducted through August 12, 2024, with citation screening for additional studies. Eligible studies applied machine learning or deep learning methods to multimodal data combining pathology images and -omics. Data extraction followed the CHARMS checklist, and risk of bias was assessed using the PROBAST + AI tool. Narrative synthesis was conducted in line with PRISMA 2020 guidelines. Forty-eight studies published since 2017 met inclusion criteria, spanning 19 cancer types. All relied on The Cancer Genome Atlas dataset. Modelling approaches included regularised Cox regression (n = 4), classical machine learning (n = 13), and deep learning (n = 31). Reported concordance indices ranged from 0.550 to 0.857, with most multimodal models outperforming unimodal counterparts. However, all studies were assessed as having high or unclear risk of bias—most often due to limited external validation, insufficient reporting, and minimal assessment of clinical utility. This review highlights a rapidly evolving yet methodologically underdeveloped field. While model performance is promising, improvements in data standardisation, reporting practices, and real-world contextualisation are critical for clinical translation. This work was funded by the National Pathology Imaging Cooperative (NPIC), supported by UK Research and Innovation (Project no. 104687).

Cancer InformaticsVol. 25
Linköping University (SE), University of Leeds (GB), Leeds Teaching Hospitals NHS Trust (GB)
Industry, innovation and infrastructure
Openalex Percentile: Top 3%
AI in cancer detection
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.