"Pipe-Laying": A novel fusion of 3D MRI and health records for the early detection and diagnosis of Alzheimer's disease using deep learning

Alzheimer's disease (AD) is a prevalent form of dementia that impacts brain cells. Although its likelihood increases with age, there is no transitional period between its stages. In order to enhance diagnostic precision, physicians rely on clinical judgments derived from interpreting health data, considering demographics, clinical history, and laboratory results to detect AD at an early stage. While patient cognitive tests and demographic information are primarily presented in text, brain scan images are presented in graphic formats. Researchers typically use different classifiers for each data format and then merge the classifier outcomes to maximize classification accuracy and utilize all patient-related data for the final decision. However, this approach leads to low performance, diminishing predictive abilities and model effectiveness. We propose an innovative approach that combines diverse textual health records (HR) with three-dimensional structural magnetic resonance imaging (3D sMRI) to achieve a similar objective in computer-aided diagnosis, utilizing a novel deep learning technique. Health records, encompassing demographic features like age, gender, apolipoprotein gene, and mini-mental state examination score, are fused with 3D sMRI, enabling a graphic-based deep learning strategy for early AD detection. The fusion of data is accomplished by representing textual information as graphic pipes and integrating them into 3D sMRI, a method referred to as the "pipe-laying" method. This unified approach enables simultaneous processing of textual health records and 3D sMRI data within a single convolutional framework. Experimental results from over 4000 sMRI scans of 780 patients in the AD Neuroimaging Initiative (ADNI) dataset demonstrate that the pipe-laying method enhances recognition accuracy rates for Early Mild Cognitive Impairment (EMCI) and Late Mild Cognitive Impairment (LMCI) patients, accurately classifying all AD patients. In a 4-class AD diagnosis scenario, encompassing AD, LMCI, EMCI, Cognitively Normal (CN) accuracy improved from 86.87% when only 3D images were used to 90.00% when 3D sMRI and patient health records were included. Thus, the positive impact of combining 3D sMRI with HR on 4-class AD diagnosis was established.

Authors

Institutions

Publication Details

Journal
PLoS ONE
Published
2026-11-17
DOI
https://doi.org/10.1371/journal.pone.0362862
Citations
4
Primary Topic
Dementia and Cognitive Impairment Research
Type
article
Field-Weighted Citation Impact
2.69

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

"Pipe-Laying": A novel fusion of 3D MRI and health records for the early detection and diagnosis of Alzheimer's disease using deep learning

Savaş Okyay, Nihat Adar, Arman Atalar
4 citations
PLoS ONE
Dementia and Cognitive Impairment Research
2.69
article

"Pipe-Laying": A novel fusion of 3D MRI and health records for the early detection and diagnosis of Alzheimer's disease using deep learning

Savaş Okyay, Nihat Adar, Arman Atalar
article en
4 citations

Abstract

Alzheimer's disease (AD) is a prevalent form of dementia that impacts brain cells. Although its likelihood increases with age, there is no transitional period between its stages. In order to enhance diagnostic precision, physicians rely on clinical judgments derived from interpreting health data, considering demographics, clinical history, and laboratory results to detect AD at an early stage. While patient cognitive tests and demographic information are primarily presented in text, brain scan images are presented in graphic formats. Researchers typically use different classifiers for each data format and then merge the classifier outcomes to maximize classification accuracy and utilize all patient-related data for the final decision. However, this approach leads to low performance, diminishing predictive abilities and model effectiveness. We propose an innovative approach that combines diverse textual health records (HR) with three-dimensional structural magnetic resonance imaging (3D sMRI) to achieve a similar objective in computer-aided diagnosis, utilizing a novel deep learning technique. Health records, encompassing demographic features like age, gender, apolipoprotein gene, and mini-mental state examination score, are fused with 3D sMRI, enabling a graphic-based deep learning strategy for early AD detection. The fusion of data is accomplished by representing textual information as graphic pipes and integrating them into 3D sMRI, a method referred to as the "pipe-laying" method. This unified approach enables simultaneous processing of textual health records and 3D sMRI data within a single convolutional framework. Experimental results from over 4000 sMRI scans of 780 patients in the AD Neuroimaging Initiative (ADNI) dataset demonstrate that the pipe-laying method enhances recognition accuracy rates for Early Mild Cognitive Impairment (EMCI) and Late Mild Cognitive Impairment (LMCI) patients, accurately classifying all AD patients. In a 4-class AD diagnosis scenario, encompassing AD, LMCI, EMCI, Cognitively Normal (CN) accuracy improved from 86.87% when only 3D images were used to 90.00% when 3D sMRI and patient health records were included. Thus, the positive impact of combining 3D sMRI with HR on 4-class AD diagnosis was established.

PLoS ONEVol. 21(11)
Yıldız Technical University (TR), Eskişehir Osmangazi University (TR), Canadian Institute of Technology (AL)
U.S. Department of Defense, Foundation for the National Institutes of Health, Alzheimer's Association, Bristol-Myers Squibb, Eli Lilly and Company, Pfizer, Roche, Biogen, University of Southern California, Meso Scale Diagnostics, Alzheimer's Disease Neuroimaging Initiative, BioClinica, Novartis Pharmaceuticals Corporation, Northern California Institute for Research and Education, Eisai, Servier, H. Lundbeck A/S, IXICO, National Institutes of Health, Genentech, Johnson and Johnson, Canadian Institutes of Health Research, National Institute on Aging, National Institute of Biomedical Imaging and Bioengineering
Good health and well-being
Openalex Percentile: Top 18%
Dementia and Cognitive Impairment Research
2.69
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon