MA02.11 Validation of the Sybil Deep Learning Lung Cancer Risk Prediction Model in Three Independent Screening Studies

Introduction: A 4-protein biomarker panel (4MP) has been shown to improve estimation of lung cancer risk and identify individuals who may benefit most from lung cancer screening.In the current study, we evaluated the performance of the 4MP for risk determination of lung cancer in the multicenter National Lung Screening Trial (NLST).Methods: The 4MP was assessed in two nested case-control cohorts of plasma samples from the NLST.The first cohort consisted of 675 samples from individuals with CT scans without suspicious findings, including 135 eventually diagnosed with lung cancer and 540 matched control samples.The second cohort consisted of 715 samples from individuals with screen-detected pulmonary nodules, including 143 diagnosed with cancer before the next screening timepoint and 572 matched controls.The 4MP was measured using a multiplex beadbased immunoassay using coefficients fixed from a previously developed logistic regression model.Performance was evaluated using receiver operating characteristic analysis, including computing the area under the curve (AUCs) as well as a net reclassification index (NRI) to estimate how well the 4MP improved existing risk prediction models such as the Brock nodule risk calculator.Results: In the cohort with negative CTs, for those individuals eventually diagnosed with stage II or higher lung cancer, the 4MP showed an AUC of 0.67 (95% CI 0.59-0.74).For all those with advanced (stage III and higher), AUC was 0.71 (95% CI 0.61-0.81).For individuals diagnosed within 1 year of blood draw, the AUC was 0.71 (95% CI 0.51-0.91).In those with indeterminate nodules, the 4MP showed similar performance, with an AUC of 0.64 (95% CI 0.59-0.70) in those eventually diagnosed with stage II or higher lung cancer.The 4MP, added to the Brock model, showed an NRI of 0.26 compared to the Brock model alone.Conclusions: The 4MP may be a useful adjunct to screening, especially in identifying those who will develop more advanced stage disease in the following year.This could help to identify individuals who may benefit from closer clinical follow-up.

Authors

Institutions

Publication Details

Journal
Journal of Thoracic Oncology
Published
2024-10-01
DOI
https://doi.org/10.1016/j.jtho.2024.09.106
Citations
3
Primary Topic
Artificial Intelligence in Healthcare
Type
article
Field-Weighted Citation Impact
2.12
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

MA02.11 Validation of the Sybil Deep Learning Lung Cancer Risk Prediction Model in Three Independent Screening Studies

G. Liu, R. Phellan Aro, R Myers, R. Meza et al.
3 citations
Journal of Thoracic Oncology
Artificial Intelligence in Healthcare
2.12
article

MA02.11 Validation of the Sybil Deep Learning Lung Cancer Risk Prediction Model in Three Independent Screening Studies

G. Liu, R. Phellan Aro, R Myers, R. Meza, David O. Wilson, Matthew T. Warkentin, S. Lam, Jian‐Min Yuan, Brenda Diergaarde, R. J. Hung
article en
3 citations

Abstract

Introduction: A 4-protein biomarker panel (4MP) has been shown to improve estimation of lung cancer risk and identify individuals who may benefit most from lung cancer screening.In the current study, we evaluated the performance of the 4MP for risk determination of lung cancer in the multicenter National Lung Screening Trial (NLST).Methods: The 4MP was assessed in two nested case-control cohorts of plasma samples from the NLST.The first cohort consisted of 675 samples from individuals with CT scans without suspicious findings, including 135 eventually diagnosed with lung cancer and 540 matched control samples.The second cohort consisted of 715 samples from individuals with screen-detected pulmonary nodules, including 143 diagnosed with cancer before the next screening timepoint and 572 matched controls.The 4MP was measured using a multiplex beadbased immunoassay using coefficients fixed from a previously developed logistic regression model.Performance was evaluated using receiver operating characteristic analysis, including computing the area under the curve (AUCs) as well as a net reclassification index (NRI) to estimate how well the 4MP improved existing risk prediction models such as the Brock nodule risk calculator.Results: In the cohort with negative CTs, for those individuals eventually diagnosed with stage II or higher lung cancer, the 4MP showed an AUC of 0.67 (95% CI 0.59-0.74).For all those with advanced (stage III and higher), AUC was 0.71 (95% CI 0.61-0.81).For individuals diagnosed within 1 year of blood draw, the AUC was 0.71 (95% CI 0.51-0.91).In those with indeterminate nodules, the 4MP showed similar performance, with an AUC of 0.64 (95% CI 0.59-0.70) in those eventually diagnosed with stage II or higher lung cancer.The 4MP, added to the Brock model, showed an NRI of 0.26 compared to the Brock model alone.Conclusions: The 4MP may be a useful adjunct to screening, especially in identifying those who will develop more advanced stage disease in the following year.This could help to identify individuals who may benefit from closer clinical follow-up.

Journal of Thoracic OncologyVol. 19(10)
University of Calgary (CA), University of Pittsburgh (US), Lunenfeld-Tanenbaum Research Institute (CA), CancerCare (US), UPMC Hillman Cancer Center (US), BC Cancer Foundation (CA)
Good health and well-being
Openalex Percentile: Top 10%
Artificial Intelligence in Healthcare
2.12
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.