Dual chain-of-thought AI‑PDCA framework for clinical history taking and documentation
Abstract Clinical history-taking and documentation are foundational competencies in undergraduate medical training, yet scalable and individualized training tools remain limited. Large language model (LLM)-based systems provide automated practice opportunities but often lack structured medical reasoning, closed-loop instructional design, and integration into formal curricula. As part of a curriculum reform initiative, we constructed a clinical case repository, developed an artificial intelligence (AI)-integrated faculty Plan–Do–Check–Act (PDCA) training framework supported by dual chain-of-thought (CoT)-driven LLMs, and evaluated the reliability of AI-based scoring against faculty assessment. We then conducted a retrospective observational analysis of routinely collected educational performance data from 135 undergraduate medical students enrolled in one of three existing instructional configurations: traditional instruction, AI-assisted training, or AI + PDCA training. Educational outcomes were assessed using standardized Objective Structured Clinical Examination (OSCE) assessments. The AI + PDCA configuration was associated with the highest OSCE performance in both history-taking and clinical documentation. Among the two AI-supported configurations, longitudinal mixed-effects modeling showed steeper learning trajectories in the AI + PDCA configuration than in the AI-assisted configuration. These findings suggest that integrating AI-derived learning analytics with faculty-guided instructional intervention may support a closed-loop educational model associated with favorable competency acquisition while maintaining human oversight. This framework offers a scalable approach for implementing trustworthy, competency-based AI-enhanced medical education in routine academic practice.
Authors
- Yin Ru Chen (ORCID: https://orcid.org/0000-0002-6970-1855)
- Shaoxin Li (ORCID: https://orcid.org/0000-0001-8396-8815)
- Zijin Chen (ORCID: https://orcid.org/0009-0000-8978-5470)
- Weiguo Hu (ORCID: https://orcid.org/0000-0003-2156-6233)
- Yan Ouyang (ORCID: https://orcid.org/0000-0002-3181-8708)
- Jiaxiang Wu (ORCID: https://orcid.org/0000-0001-9203-9372)
- Lifeng Zhu (ORCID: https://orcid.org/0009-0007-8129-0060)
- Lin Hu
- Weiqiong Gu
- Qian Gu
- Boyuan Deng
- Xuelian Wang
- Feiyue Huang
Institutions
- Shanghai Jiao Tong University (CN)
- National Health and Family Planning Commission (CN)
- Ruijin Hospital (CN)
Publication Details
- Journal
- npj Digital Medicine
- Published
- 2026-11-16
- DOI
- https://doi.org/10.1038/s41746-026-03430-7
- Primary Topic
- Artificial Intelligence in Healthcare and Education
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Shanghai Municipal Education Commission
- Shanghai Jiao Tong University
- Fundamental Research Funds for the Central Universities