Explainable brain age prediction: a comparative evaluation of morphometric and deep learning pipelines

Brain age, a biomarker reflecting brain health relative to chronological age, is increasingly used in neuroimaging to detect early signs of neurodegenerative diseases and support personalized treatment plans. Two primary approaches for brain age prediction have emerged: morphometric feature extraction from MRI scans and deep learning (DL) applied to raw MRI data. However, a systematic comparison of these methods regarding performance, interpretability, and clinical utility has been limited. In this study, we present a comparative evaluation of two pipelines: one using morphometric features from FreeSurfer and the other employing 3D convolutional neural networks (CNNs). Using a multisite neuroimaging dataset, we assessed both model performance and the interpretability of predictions through eXplainable Artificial Intelligence (XAI) methods, applying SHAP to the feature-based pipeline and Grad-CAM and DeepSHAP to the CNN-based pipeline. Our results show comparable performance between the two pipelines in Leave-One-Site-Out (LOSO) validation, achieving state-of-the-art performance on the independent test set ( <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"><mml:mrow><mml:mi>M</mml:mi> <mml:mi>A</mml:mi> <mml:mi>E</mml:mi> <mml:mo>=</mml:mo> <mml:mn>3.21</mml:mn></mml:mrow> </mml:math> with DNN and morphometric features and <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"><mml:mrow><mml:mi>M</mml:mi> <mml:mi>A</mml:mi> <mml:mi>E</mml:mi> <mml:mo>=</mml:mo> <mml:mn>3.08</mml:mn></mml:mrow> </mml:math> with a DenseNet-121 architecture). SHAP provided the most consistent and interpretable results, while DeepSHAP exhibited greater variability. Further work is needed to assess the clinical utility of Grad-CAM. This study addresses a critical gap by systematically comparing the interpretability of multiple XAI methods across distinct brain age prediction pipelines. Our findings underscore the importance of integrating XAI into clinical practice, offering insights into how XAI outputs vary and their potential utility for clinicians.

Authors

Institutions

Publication Details

Journal
Brain Informatics
Published
2024-12-01
DOI
https://doi.org/10.1186/s40708-024-00244-9
Citations
9
Primary Topic
Machine Learning in Healthcare
Type
article
Field-Weighted Citation Impact
3.13
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Explainable brain age prediction: a comparative evaluation of morphometric and deep learning pipelines

Carmelo Ardito, Tommaso Di Noia, Eugenio Di Sciascio, Giancarmine Fasano et al.
9 citations
Brain Informatics
Machine Learning in Healthcare
3.13
article

Explainable brain age prediction: a comparative evaluation of morphometric and deep learning pipelines

Carmelo Ardito, Tommaso Di Noia, Eugenio Di Sciascio, Giancarmine Fasano, Angela Lombardi, Antonio Ferrara, Maria Luigia Natalia De Bonis
article en
9 citations

Abstract

Brain age, a biomarker reflecting brain health relative to chronological age, is increasingly used in neuroimaging to detect early signs of neurodegenerative diseases and support personalized treatment plans. Two primary approaches for brain age prediction have emerged: morphometric feature extraction from MRI scans and deep learning (DL) applied to raw MRI data. However, a systematic comparison of these methods regarding performance, interpretability, and clinical utility has been limited. In this study, we present a comparative evaluation of two pipelines: one using morphometric features from FreeSurfer and the other employing 3D convolutional neural networks (CNNs). Using a multisite neuroimaging dataset, we assessed both model performance and the interpretability of predictions through eXplainable Artificial Intelligence (XAI) methods, applying SHAP to the feature-based pipeline and Grad-CAM and DeepSHAP to the CNN-based pipeline. Our results show comparable performance between the two pipelines in Leave-One-Site-Out (LOSO) validation, achieving state-of-the-art performance on the independent test set ( <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"><mml:mrow><mml:mi>M</mml:mi> <mml:mi>A</mml:mi> <mml:mi>E</mml:mi> <mml:mo>=</mml:mo> <mml:mn>3.21</mml:mn></mml:mrow> </mml:math> with DNN and morphometric features and <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"><mml:mrow><mml:mi>M</mml:mi> <mml:mi>A</mml:mi> <mml:mi>E</mml:mi> <mml:mo>=</mml:mo> <mml:mn>3.08</mml:mn></mml:mrow> </mml:math> with a DenseNet-121 architecture). SHAP provided the most consistent and interpretable results, while DeepSHAP exhibited greater variability. Further work is needed to assess the clinical utility of Grad-CAM. This study addresses a critical gap by systematically comparing the interpretability of multiple XAI methods across distinct brain age prediction pipelines. Our findings underscore the importance of integrating XAI into clinical practice, offering insights into how XAI outputs vary and their potential utility for clinicians.

Brain InformaticsVol. 11(1)
Polytechnic University of Bari (IT)
Openalex Percentile: Top 7%
Machine Learning in Healthcare
3.13
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.