Evaluation of Large Language Model Performance in Assessing Health Economic Study Quality
This study demonstrated an exploratory proof-of-concept application of LLMs to research quality evaluation. Our results suggests that the LLM was generally able to provide well-reasoned evaluations that closely aligned with human assessments, although with some limitations in fully supporting its judgments.
Authors
- Harold P. Lehmann (ORCID: https://orcid.org/0000-0002-7698-219X)
- Ha Eun Lee (ORCID: https://orcid.org/0000-0002-1259-6425)
- Minqi Xiong (ORCID: https://orcid.org/0009-0001-0289-148X)
- Chen Dun (ORCID: https://orcid.org/0000-0003-4220-5939)
- Robert Barrett (ORCID: https://orcid.org/0000-0003-3761-5079)
- Qingrui Wang
- Sang-Ho Lee (ORCID: https://orcid.org/0000-0001-5943-7715)
- Yiheng Wang (ORCID: https://orcid.org/0000-0002-0263-9313)
- Cody J. Couperus
Institutions
- Johns Hopkins University (US)
- Johns Hopkins Medicine (US)
Publication Details
- Journal
- Journal of health economics and outcomes research
- Published
- 2025-10-24
- DOI
- https://doi.org/10.36469/001c.145214
- Citations
- 1
- Primary Topic
- Health Systems, Economic Evaluations, Quality of Life
- Type
- article
- Field-Weighted Citation Impact
- 3.13