LLMs as Medical Safety Judges: Evaluating Alignment with Human Annotation in Patient-Facing QA
Yella Diekmann, Chase Fensore, Rodrigo Carrillo-Larco, Eduard Castejon Rosales, Sakshi Shiromani, Rima Pai, Megha Shah, Joyce Ho. Proceedings of the 24th Workshop on Biomedical Language Processing. 2025.
Authors
- Megha Shah (ORCID: https://orcid.org/0000-0002-6722-7846)
- Joyce C. Ho (ORCID: https://orcid.org/0000-0001-9168-3916)
- Rodrigo M. Carrillo‐Larco (ORCID: https://orcid.org/0000-0002-2090-1856)
- Chase M. Fensore (ORCID: https://orcid.org/0009-0007-6761-1809)
- Yella Diekmann
- Eduard Castejon Rosales
- Sakshi Shiromani
- Rima Pai
Publication Details
- Published
- 2025-01-01
- DOI
- https://doi.org/10.18653/v1/2025.bionlp-1.19
- Citations
- 1
- Primary Topic
- Artificial Intelligence in Law
- Type
- article
- Field-Weighted Citation Impact
- 8.52
Funders
- National Science Foundation
- National Institute on Minority Health and Health Disparities