Early prediction of liver metastasis in pancreatic cancer using routine clinical data: an externally validated machine learning model

Liver metastasis at the time of pancreatic cancer diagnosis plays a critical role in treatment planning owing to its strong association with poor prognosis. However, they often remain undetected because of the limited sensitivity of conventional imaging and biomarkers. Previous studies have primarily focused on postoperative liver metastasis or relied on complex nonroutine variables (e.g., liquid biopsy and radiomics), which limit scalability and real-world applicability. To address this unmet need, we applied an machine learning (ML) approach chosen for its interpretability, developing a simple, real-time prediction model that uses only routine clinical data available at diagnosis. We retrospectively enrolled 2,657 patients with pancreatic cancer from a tertiary centre to develop the Liver Metastasis in Pancreatic Cancer (LiMPC) model. The model was trained using 21 routinely available clinical variables and compared across four ML algorithms. The best performing model (extreme gradient boosting) was calibrated using isotonic regression and externally validated in five independent hospitals (n = 272). Model performance was evaluated using AUROC, sensitivity, specificity, negative predictive value, positive predictive value, and calibration plots. Clinical utility was assessed with decision curve analysis, and feature contributions were interpreted using SHapley Additive exPlanations (SHAP). The fine-tuned LiMPC model achieved strong external validation performance (AUROC = 0.78, sensitivity = 0.81, specificity = 0.55) with robust calibration and consistent clinical net benefit. SHAP interpretation identified CA19-9, CEA, GGT, and age as key predictors, consistent with established biomarkers of advanced disease. In the subgroup analysis, the model achieved particularly strong discrimination in older (AUROC = 0.82) and male (AUROC = 0.82) patients, suggesting demographic influences on metastatic risk. In supplementary analyses, baseline predictors remained consistent among patients who later developed liver metastasis, reinforcing the model’s biological plausibility and clinical relevance. LiMPC is an externally validated, interpretable tool for liver metastasis risk stratification using routinely collected clinical data. As a hypothesis-generating tool, it demonstrates how simple clinical variables can provide decision support when imaging results are inconclusive, offering a practical framework for future prospective validation and clinical implementation.

Authors

Institutions

Publication Details

Journal
BMC Cancer
Published
2025-11-27
DOI
https://doi.org/10.1186/s12885-025-15285-4
Primary Topic
Pancreatic and Hepatic Oncology Research
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Early prediction of liver metastasis in pancreatic cancer using routine clinical data: an externally validated machine learning model

Galam Leem, Jae Hee Cho, Sung Ill Jang, Ji Hoon Park et al.
BMC Cancer
Pancreatic and Hepatic Oncology Research
article

Early prediction of liver metastasis in pancreatic cancer using routine clinical data: an externally validated machine learning model

Galam Leem, Jae Hee Cho, Sung Ill Jang, Ji Hoon Park, Moon Jae Chung, Seungmin Bang, See Young Lee, Kyung In Shin, Jiyoung Keum, Jung Hyun Jo, Jeong Youp Park, Sang Hoon Lee, Hee Seung Lee, Seung Up Kim, Seung Woo Park, Won‐Kyu Lee, Y.J. Ko, Jee Hoon Kim
article en

Abstract

Liver metastasis at the time of pancreatic cancer diagnosis plays a critical role in treatment planning owing to its strong association with poor prognosis. However, they often remain undetected because of the limited sensitivity of conventional imaging and biomarkers. Previous studies have primarily focused on postoperative liver metastasis or relied on complex nonroutine variables (e.g., liquid biopsy and radiomics), which limit scalability and real-world applicability. To address this unmet need, we applied an machine learning (ML) approach chosen for its interpretability, developing a simple, real-time prediction model that uses only routine clinical data available at diagnosis. We retrospectively enrolled 2,657 patients with pancreatic cancer from a tertiary centre to develop the Liver Metastasis in Pancreatic Cancer (LiMPC) model. The model was trained using 21 routinely available clinical variables and compared across four ML algorithms. The best performing model (extreme gradient boosting) was calibrated using isotonic regression and externally validated in five independent hospitals (n = 272). Model performance was evaluated using AUROC, sensitivity, specificity, negative predictive value, positive predictive value, and calibration plots. Clinical utility was assessed with decision curve analysis, and feature contributions were interpreted using SHapley Additive exPlanations (SHAP). The fine-tuned LiMPC model achieved strong external validation performance (AUROC = 0.78, sensitivity = 0.81, specificity = 0.55) with robust calibration and consistent clinical net benefit. SHAP interpretation identified CA19-9, CEA, GGT, and age as key predictors, consistent with established biomarkers of advanced disease. In the subgroup analysis, the model achieved particularly strong discrimination in older (AUROC = 0.82) and male (AUROC = 0.82) patients, suggesting demographic influences on metastatic risk. In supplementary analyses, baseline predictors remained consistent among patients who later developed liver metastasis, reinforcing the model’s biological plausibility and clinical relevance. LiMPC is an externally validated, interpretable tool for liver metastasis risk stratification using routinely collected clinical data. As a hypothesis-generating tool, it demonstrates how simple clinical variables can provide decision support when imaging results are inconclusive, offering a practical framework for future prospective validation and clinical implementation.

BMC CancerVol. 26(1)
Ewha Womans University (KR), Yonsei University (KR), Konkuk University (KR), Severance Hospital (KR), Gangnam Severance Hospital (KR), Yonsei University Health System (KR), Keimyung University (KR)
Openalex Percentile: Top 49%
Pancreatic and Hepatic Oncology Research
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.