Performance of an AI‐based prediction model versus stratified thresholds using plasma biomarkers for biological staging of AD

Abstract Background The potential clinical utility of plasma biomarkers for biological staging of AD demands definition and validation of cutoff values. Plasma ptau‐217 and GFAP have accurately predicted core pathological changes such as tau aggregation and amyloid (Aβ) deposition, being proposed as complementary biomarkers. Thus, we aim to test a staging framework with plasma GFAP and ptau‐217 using cuttof values to predict Aβ/Tau PET stages and compare its performance with an artificial intelligence (AI) prediction model. Methods We included 362 individuals from TRIAD cohort and classified by Aβ and Tau PET in 5 biological stages and in 3 PET simplified stages (Table 1), representing the gold‐standard. For the AI model, we performed feature selection of 12 variables (Figure 1A) and repeated the model removing lower importance variables until reaching highest accuracy. For the classic thresholding method, we selected plasma GFAP(Quanterix) and plasma ptau‐217(Janssen) and defined lower and higher thresholds with ROC curves for PET stages discrimination in cognitively impaired individuals. Plasma stages were then defined for 199 participants that had GFAP and ptau‐217 data (Figure 2A). Results Our study revealed that the AI Ensemble Boosted Trees model was the most accurate in distinguishing PET simplified stages, utilizing 6 key variables (Figure 1). Through 5‐fold cross‐validation, the model achieved a validation AUC of 0.91 for predicting stage‐2 and 0.83 for stage‐0, with a consistent test AUC of 0.94 for both stages. Notably, plasma ptau‐217 emerged as the most significant predictor among the ptau‐x variables, closely followed by GFAP (Figure 1). Our analysis using plasma thresholds for GFAP and ptau‐217 (Figure 2A) yielded AUCs of 0.78 for stage‐0 and 0.85 for stage‐2 predictions. A comparative assessment of confusion matrices showed similar accuracies (Figure 2B). Importantly, our threshold‐based classification accurately detected 96% of early/stage‐1 cases as positive and correctly avoided any misclassification of late/stage‐2 cases as stage‐0. Conclusions Our threshold‐based framework, which utilizes plasma GFAP and ptau‐217, exhibits potential for the biological staging of AD, having achieved comparable accuracy to AI‐based methods that employ multiple plasma biomarkers and demographics to detect PET stages. This framework is straightforward, relies solely on two blood biomarkers and clinically‐stratified thresholds, and holds promise for implementation in clinical practice.

Authors

Institutions

Publication Details

Journal
Alzheimer s & Dementia
Published
2024-12-01
DOI
https://doi.org/10.1002/alz.092879
Citations
1
Primary Topic
Machine Learning in Healthcare
Type
article
Field-Weighted Citation Impact
0.35
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Performance of an AI‐based prediction model versus stratified thresholds using plasma biomarkers for biological staging of AD

Dana Tudorascu, Madeleine Bloomquist, Tharick Ali Pascoal, Joseph Therriault et al.
1 citations
Alzheimer s & Dementia
Machine Learning in Healthcare
0.35
article

Performance of an AI‐based prediction model versus stratified thresholds using plasma biomarkers for biological staging of AD

Dana Tudorascu, Madeleine Bloomquist, Tharick Ali Pascoal, Joseph Therriault, Cynthia Felix, Guilherme Povala, Carolina Soares, Lucas Porcello Schilling, Guilherme Bauer‐Negrini, Nesrine Rahmouni, Pâmela C.L. Ferreira, Emma Patrice Ruppert, Matheus Scarpatto Rodrigues, Thomas K. Karikari, Bruna Bellaver, Sarah Abbas, Firoza Zubeida Lussier, Cristiano Schaffer Aguzzoli, Lívia Amaral, Cécile Tissot, Hussein Zalzale, Pedro Rosa‐Neto, Pampa Saha, Andréa L. Benedet, Markley S. Oliveira, Marina Scop Madeiros, Juli Cehula, Devin J Fine
article en
1 citations

Abstract

Abstract Background The potential clinical utility of plasma biomarkers for biological staging of AD demands definition and validation of cutoff values. Plasma ptau‐217 and GFAP have accurately predicted core pathological changes such as tau aggregation and amyloid (Aβ) deposition, being proposed as complementary biomarkers. Thus, we aim to test a staging framework with plasma GFAP and ptau‐217 using cuttof values to predict Aβ/Tau PET stages and compare its performance with an artificial intelligence (AI) prediction model. Methods We included 362 individuals from TRIAD cohort and classified by Aβ and Tau PET in 5 biological stages and in 3 PET simplified stages (Table 1), representing the gold‐standard. For the AI model, we performed feature selection of 12 variables (Figure 1A) and repeated the model removing lower importance variables until reaching highest accuracy. For the classic thresholding method, we selected plasma GFAP(Quanterix) and plasma ptau‐217(Janssen) and defined lower and higher thresholds with ROC curves for PET stages discrimination in cognitively impaired individuals. Plasma stages were then defined for 199 participants that had GFAP and ptau‐217 data (Figure 2A). Results Our study revealed that the AI Ensemble Boosted Trees model was the most accurate in distinguishing PET simplified stages, utilizing 6 key variables (Figure 1). Through 5‐fold cross‐validation, the model achieved a validation AUC of 0.91 for predicting stage‐2 and 0.83 for stage‐0, with a consistent test AUC of 0.94 for both stages. Notably, plasma ptau‐217 emerged as the most significant predictor among the ptau‐x variables, closely followed by GFAP (Figure 1). Our analysis using plasma thresholds for GFAP and ptau‐217 (Figure 2A) yielded AUCs of 0.78 for stage‐0 and 0.85 for stage‐2 predictions. A comparative assessment of confusion matrices showed similar accuracies (Figure 2B). Importantly, our threshold‐based classification accurately detected 96% of early/stage‐1 cases as positive and correctly avoided any misclassification of late/stage‐2 cases as stage‐0. Conclusions Our threshold‐based framework, which utilizes plasma GFAP and ptau‐217, exhibits potential for the biological staging of AD, having achieved comparable accuracy to AI‐based methods that employ multiple plasma biomarkers and demographics to detect PET stages. This framework is straightforward, relies solely on two blood biomarkers and clinically‐stratified thresholds, and holds promise for implementation in clinical practice.

Alzheimer s & DementiaVol. 20(S2)
University of Pittsburgh (US), McGill University Health Centre (CA), Instituto do Cérebro (BR), Global Brain Health Institute (US), Pontifícia Universidade Católica do Rio Grande do Sul (BR), McGill University (CA)
Reduced inequalities, Peace, Justice and strong institutions
Openalex Percentile: Top 30%
Machine Learning in Healthcare
0.35
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.