ElderDocAI: Evidence-Grounded Retrieval-Augmented Generation with Reliability Gating and Care-State Adaptation for Older-Adult Care

Large language models can support caregiver-facing assistance, but ungrounded responses pose risks in older-adult care. We present ElderDocAI, a framework combining hybrid retrieval, reliability-gated generation, and rule-based care-state adaptation. Evaluation on GeriLit-Gold v1.1 (121 questions from 45 PubMed Central articles) yielded mean faithfulness of 0.754, answer relevance of 0.672, and evidence support of 0.853. The full pipeline outperformed vanilla retrieval-augmented generation (RAG) across all three metrics, while reliability gating alone showed no significant improvement. Gold evidence was retrieved for 27.3% of questions (Recall@3 = 0.273; MRR = 0.238). Among five alternative generator models, Phi-3.5 achieved the highest faithfulness (0.900–0.923) but failed on one question in both runs, and Mistral 7B achieved the highest answer relevance (0.711) and evidence support (0.817); refusal rates ranged from none to 47 of 121 questions. Care-state adaptation did not produce responses judged appropriate in the controlled evaluation. These findings highlight generator choice and retrieval coverage as important factors in evidence-grounded older-adult care assistance. Clinical effectiveness and longitudinal behavior remain unevaluated.

Authors

Publication Details

Journal
Preprints.org
Published
2026-11-11
DOI
https://doi.org/10.20944/preprints202611.1094.v1
Primary Topic
Artificial Intelligence in Healthcare and Education
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

ElderDocAI: Evidence-Grounded Retrieval-Augmented Generation with Reliability Gating and Care-State Adaptation for Older-Adult Care

Laura Akinyi, Deogratius Muruga, Kyungho Yu, Kim Pankoo et al.
Preprints.org
Artificial Intelligence in Healthcare and Education
preprint

ElderDocAI: Evidence-Grounded Retrieval-Augmented Generation with Reliability Gating and Care-State Adaptation for Older-Adult Care

Laura Akinyi, Deogratius Muruga, Kyungho Yu, Kim Pankoo, Patience Wangui Gichuhi
preprint en

Abstract

Large language models can support caregiver-facing assistance, but ungrounded responses pose risks in older-adult care. We present ElderDocAI, a framework combining hybrid retrieval, reliability-gated generation, and rule-based care-state adaptation. Evaluation on GeriLit-Gold v1.1 (121 questions from 45 PubMed Central articles) yielded mean faithfulness of 0.754, answer relevance of 0.672, and evidence support of 0.853. The full pipeline outperformed vanilla retrieval-augmented generation (RAG) across all three metrics, while reliability gating alone showed no significant improvement. Gold evidence was retrieved for 27.3% of questions (Recall@3 = 0.273; MRR = 0.238). Among five alternative generator models, Phi-3.5 achieved the highest faithfulness (0.900–0.923) but failed on one question in both runs, and Mistral 7B achieved the highest answer relevance (0.711) and evidence support (0.817); refusal rates ranged from none to 47 of 121 questions. Care-state adaptation did not produce responses judged appropriate in the controlled evaluation. These findings highlight generator choice and retrieval coverage as important factors in evidence-grounded older-adult care assistance. Clinical effectiveness and longitudinal behavior remain unevaluated.

Preprints.org
Artificial Intelligence in Healthcare and Education
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon