Explainable Feature Attribution in Heterogeneous Clinical-to-Text Transformer Language Models for Alzheimer’s Progression Diagnosis

Alzheimer’s disease (AD) progression diagnosis remains challenging due to heterogeneous clinical variables, limited cross-cohort validation, and the lack of transparent learning systems suitable for clinical use. Although large language models (LLMs) have shown strong potential, their use on structured clinical assessments remains underexplored, particularly with respect to encoder–decoder comparisons, out-of-distribution (OOD) generalization, and explainability. This paper proposes a heterogeneous clinical-to-text framework that converts structured cognitive, demographic, and clinical variables into standardized natural-language patient profiles. The framework enables a unified comparison of encoder-based transformers, decoder-only LLMs, and baseline machine learning models under the same input representation. Experiments are conducted on in-distribution (IID) and OOD cohorts for binary and multi-class AD progression diagnosis. The results show that fine-tuned encoder models consistently outperform prompt-based decoder LLMs, with ModernBERT achieving the strongest predictive performance and cross-cohort robustness. Additional evaluations using tabular/text baselines, fusion strategies, calibration, uncertainty estimation, subgroup analysis, and domain sensitivity confirm the reliability of the proposed representation. Attribution-based explainability using Gradient-SHAP, Integrated Gradients, and Gradient-Activation further demonstrates stable and clinically meaningful cognitive feature contributions, with inter-method agreement supporting explanation consistency across cohorts and diagnostic tasks. Overall, clinical-to-text fine-tuning, particularly with ModernBERT, provides an accurate, robust, and interpretable framework for AD progression diagnosis, offering guidance toward trustworthy AI systems for neurodegenerative disease assessment.

Authors

Publication Details

Journal
Apollo
Published
2026-11-11
DOI
https://doi.org/10.17863/cam.136879
Primary Topic
Machine Learning in Healthcare
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Explainable Feature Attribution in Heterogeneous Clinical-to-Text Transformer Language Models for Alzheimer’s Progression Diagnosis

Michail Mamalakis, Zhongtian Sun, Fabrizio Marozzo, Cristian Cosentino et al.
Apollo
Machine Learning in Healthcare
article

Explainable Feature Attribution in Heterogeneous Clinical-to-Text Transformer Language Models for Alzheimer’s Progression Diagnosis

Michail Mamalakis, Zhongtian Sun, Fabrizio Marozzo, Cristian Cosentino, Tiago Azevedo, Chiara D'Ercoli, Pietro Liò, Richard Bethlehem
article en

Abstract

Alzheimer’s disease (AD) progression diagnosis remains challenging due to heterogeneous clinical variables, limited cross-cohort validation, and the lack of transparent learning systems suitable for clinical use. Although large language models (LLMs) have shown strong potential, their use on structured clinical assessments remains underexplored, particularly with respect to encoder–decoder comparisons, out-of-distribution (OOD) generalization, and explainability. This paper proposes a heterogeneous clinical-to-text framework that converts structured cognitive, demographic, and clinical variables into standardized natural-language patient profiles. The framework enables a unified comparison of encoder-based transformers, decoder-only LLMs, and baseline machine learning models under the same input representation. Experiments are conducted on in-distribution (IID) and OOD cohorts for binary and multi-class AD progression diagnosis. The results show that fine-tuned encoder models consistently outperform prompt-based decoder LLMs, with ModernBERT achieving the strongest predictive performance and cross-cohort robustness. Additional evaluations using tabular/text baselines, fusion strategies, calibration, uncertainty estimation, subgroup analysis, and domain sensitivity confirm the reliability of the proposed representation. Attribution-based explainability using Gradient-SHAP, Integrated Gradients, and Gradient-Activation further demonstrates stable and clinically meaningful cognitive feature contributions, with inter-method agreement supporting explanation consistency across cohorts and diagnostic tasks. Overall, clinical-to-text fine-tuning, particularly with ModernBERT, provides an accurate, robust, and interpretable framework for AD progression diagnosis, offering guidance toward trustworthy AI systems for neurodegenerative disease assessment.

Apollo
Machine Learning in Healthcare
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon