Multimodal deep learning approach for frailty classification using electrocardiogram and chest X-ray imaging

Frailty is a critical age-related syndrome associated with increased risks of disability, hospitalization, and mortality. While Comprehensive Geriatric Assessment (CGA) is the standard for evaluation, it is often subjective, time-consuming, and resource-intensive. To address these limitations, this study developed and validated a multimodal deep learning framework that integrates chest X-rays (CXR) and electrocardiograms (ECG) to provide an objective and rapid tool for frailty classification. We retrospectively analyzed data from 2,830 older adults who underwent CGA between 2007 and 2024, partitioned chronologically into training, validation, and test sets. Frailty was defined using a Multidimensional Frailty Score (MFS) > 5. Three deep learning models were trained and evaluated: a CXR-only model (EVA-X vision transformer), an ECG-only model (DenseNet-121), and a multimodal model combining both inputs. The multimodal model outperformed the single-modality models and four non-imaging clinical baseline models incorporating age, sex, comorbidity index, or routine laboratory variables, achieving the highest area under the receiver operating characteristic curve (AUROC) of 0.778 and area under the precision-recall curve (AUPRC) of 0.726. For continuous MFS estimation, the multimodal model achieved the highest Pearson correlation (r = 0.610) and the lowest mean absolute error (MAE = 1.68) among the evaluated models. Gradient-weighted Class Activation Mapping (Grad-CAM) was used to qualitatively explore the image regions that influenced model predictions. This multimodal AI framework demonstrates modest classification performance and feasibility for frailty screening. By leveraging routinely collected clinical images, this framework may serve as a practical screening adjunct to identify older adults who may benefit from formal CGA. Further studies are needed to determine its clinical utility when applied preoperatively for the stratification of postoperative risk.

Authors

Institutions

Publication Details

Journal
PLOS Digital Health
Published
2026-11-19
DOI
https://doi.org/10.1371/journal.pdig.0001838
Primary Topic
Frailty in Older Adults
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Multimodal deep learning approach for frailty classification using electrocardiogram and chest X-ray imaging

Jinyong Park, Jung‐Yeon Choi, Kwang‐Il Kim
PLOS Digital Health
Frailty in Older Adults
article

Multimodal deep learning approach for frailty classification using electrocardiogram and chest X-ray imaging

Jinyong Park, Jung‐Yeon Choi, Kwang‐Il Kim
article en

Abstract

Frailty is a critical age-related syndrome associated with increased risks of disability, hospitalization, and mortality. While Comprehensive Geriatric Assessment (CGA) is the standard for evaluation, it is often subjective, time-consuming, and resource-intensive. To address these limitations, this study developed and validated a multimodal deep learning framework that integrates chest X-rays (CXR) and electrocardiograms (ECG) to provide an objective and rapid tool for frailty classification. We retrospectively analyzed data from 2,830 older adults who underwent CGA between 2007 and 2024, partitioned chronologically into training, validation, and test sets. Frailty was defined using a Multidimensional Frailty Score (MFS) > 5. Three deep learning models were trained and evaluated: a CXR-only model (EVA-X vision transformer), an ECG-only model (DenseNet-121), and a multimodal model combining both inputs. The multimodal model outperformed the single-modality models and four non-imaging clinical baseline models incorporating age, sex, comorbidity index, or routine laboratory variables, achieving the highest area under the receiver operating characteristic curve (AUROC) of 0.778 and area under the precision-recall curve (AUPRC) of 0.726. For continuous MFS estimation, the multimodal model achieved the highest Pearson correlation (r = 0.610) and the lowest mean absolute error (MAE = 1.68) among the evaluated models. Gradient-weighted Class Activation Mapping (Grad-CAM) was used to qualitatively explore the image regions that influenced model predictions. This multimodal AI framework demonstrates modest classification performance and feasibility for frailty screening. By leveraging routinely collected clinical images, this framework may serve as a practical screening adjunct to identify older adults who may benefit from formal CGA. Further studies are needed to determine its clinical utility when applied preoperatively for the stratification of postoperative risk.

PLOS Digital HealthVol. 5(11)
Seoul National University (KR), Seoul National University Bundang Hospital (KR)
Frailty in Older Adults
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon