Large Language Model–Assisted Discharge Instructions for Diabetic Kidney Disease: Comparative Evaluation Study
Background: Discharge instructions are an important component of the transition from hospital to home for patients with diabetic kidney disease (DKD), whose care often involves multiple comorbidities, medications, and stage-specific management needs. However, producing complete, accurate, clear, and personalized instructions can be challenging for junior physicians. Objective: This study aimed to evaluate whether large language model (LLM) assistance improves the quality of DKD discharge instructions produced by junior physicians and whether its benefits vary according to chronic kidney disease (CKD) stage. Methods: The study included 101 hospitalized patients with DKD. Discharge instructions for each patient were initially drafted by a group of junior residents (resident group); subsequently, another group of residents at the same level, with the assistance of DeepSeek-V3.2 (AI-assisted group), generated a separate set of discharge instructions for the same 101 patients, resulting in a total of 202 documents. Four clinical experts, including 2 nephrologists and 2 endocrinologists, independently scored both versions of the discharge instructions using a 5-point Likert scale across 5 dimensions: completeness, accuracy, safety, clarity, and personalization. Interrater reliability was assessed using the intraclass correlation coefficient (ICC). Results: >.05). The proportion of cases achieving a ≥1-point improvement in overall quality was 99% (100/101; 95% CI 94.6%-100.0%). Conclusions: LLM assistance improved the completeness, clarity, and personalization of DKD discharge instructions generated by junior physicians, with advantages greatest in complex cases. A human-AI collaborative model is a promising approach to reduce documentation burden.
Authors
- Lei Gong (ORCID: https://orcid.org/0000-0001-8846-6590)
- Xiaoyan Xiao (ORCID: https://orcid.org/0000-0002-6320-4807)
- Jun Qin (ORCID: https://orcid.org/0000-0002-2288-6872)
- Miaomiao Cheng (ORCID: https://orcid.org/0009-0001-5214-8037)
- Qi Zhang (ORCID: https://orcid.org/0009-0007-3647-4928)
- Huiru Wang (ORCID: https://orcid.org/0009-0006-0418-104X)
- Lei Gong (ORCID: https://orcid.org/0009-0007-7517-1348)
Institutions
- Shandong University (CN)
- Qilu Hospital of Shandong University (CN)
Publication Details
- Journal
- JMIR Medical Informatics
- Published
- 2026-11-13
- DOI
- https://doi.org/10.2196/100792
- Primary Topic
- Artificial Intelligence in Healthcare and Education
- Type
- article
- Field-Weighted Citation Impact
- 0.00