Development and validation of the provider documentation summarization quality instrument for large language models
The PDSQI-9 demonstrates robust construct validity, supporting its use in clinical practice to evaluate LLM-generated summaries and facilitate safer, more effective integration of LLMs into healthcare workflows.
Authors
- Brian W. Patterson (ORCID: https://orcid.org/0000-0002-4584-3808)
- Nicholas Pellegrino (ORCID: https://orcid.org/0000-0002-2102-2431)
- Frank Liao (ORCID: https://orcid.org/0000-0002-7577-7530)
- Peter D. Stetson (ORCID: https://orcid.org/0000-0002-8984-1302)
- Jillian K. Gorski
- Majid Afshar (ORCID: https://orcid.org/0000-0002-6368-4652)
- Kyle A Burton
- Matthew M. Kalscheur (ORCID: https://orcid.org/0000-0001-6300-3696)
- Emma Croxford (ORCID: https://orcid.org/0009-0001-9117-7009)
- Elliot First
- Yanjun Gao (ORCID: https://orcid.org/0000-0002-9341-7360)
- Cherodeep Goswami (ORCID: https://orcid.org/0009-0008-9805-4694)
- Marie Pisani (ORCID: https://orcid.org/0009-0007-0436-6631)
- S. K. Wahba Khalil
- Graham Wills
- Karen K. Wong
- Tyler Rubeor
- Miranda Schnier
- Cris G. Ebby
Institutions
- Memorial Sloan Kettering Cancer Center (US)
- University of Wisconsin–Madison (US)
- University of Wisconsin Health (US)
- University of Colorado Anschutz Medical Campus (US)
- Epic Systems (United States) (US)
Publication Details
- Journal
- Journal of the American Medical Informatics Association
- Published
- 2025-04-17
- DOI
- https://doi.org/10.1093/jamia/ocaf068
- Citations
- 18
- Primary Topic
- Electronic Health Records Systems
- Type
- article
- Field-Weighted Citation Impact
- 52.88
Funders
- U.S. National Library of Medicine