Assessing the quality of AI-generated clinical notes: validated evaluation of a large language model ambient scribe
LLM-generated Ambient notes demonstrated quality comparable to physician-authored notes across multiple specialties. While Ambient notes were more thorough and better organized, they were also less succinct and more prone to hallucination. The PDQI-9 provides a validated, practical framework for evaluating AI-generated clinical documentation. This quality assessment methodology can inform iterative quality optimization and support the standardization of ambient AI scribes in clinical practice.
Authors
- Herprit Mahal
- Emil Palm
- Astrit Manikantan
- Srikanth Subramanya Belwadi
- Mark E. Pepin
Institutions
- Maxygen (United States) (US)
- Cardiovascular Institute of the South (US)
- Santa Clara Valley Medical Center (US)
- Colorado Permanente Medical Group (US)
- Hippocration General Hospital (GR)
- Stanford University (US)
Publication Details
- Journal
- Frontiers in Artificial Intelligence
- Published
- 2025-10-22
- DOI
- https://doi.org/10.3389/frai.2025.1691499
- Citations
- 7
- Primary Topic
- Electronic Health Records Systems
- Type
- article
- Field-Weighted Citation Impact
- 20.56