Feasibility of a Specialized Large Language Model for Postgraduate Medical Examination Preparation: Single-Center Proof-Of-Concept Study
PASS demonstrated strong user acceptance and grading reliability, suggesting feasibility in high-stakes examination preparation. Experienced learners could identify major hallucinations at comparable rates to examiners, suggesting potential in self-directed learning but with continued need for caution. Further research should refine grading accuracy and explore multicenter evaluation of specialized LLMs for postgraduate medical education.
Authors
- Yun Hao Leong (ORCID: https://orcid.org/0000-0003-2571-4491)
- Sui An Lie (ORCID: https://orcid.org/0000-0001-8565-1934)
- Yuhe Ke (ORCID: https://orcid.org/0000-0001-7193-4749)
- Victoria Yu Jia Tay (ORCID: https://orcid.org/0009-0000-4759-0966)
- Lathiga Nambiar (ORCID: https://orcid.org/0009-0000-1267-350X)
Institutions
- Singapore General Hospital (SG)
- Sengkang General Hospital (SG)
Publication Details
- Journal
- JMIR Formative Research
- Published
- 2025-12-03
- DOI
- https://doi.org/10.2196/77580
- Citations
- 1
- Primary Topic
- Innovations in Medical Education
- Type
- article
- Field-Weighted Citation Impact
- 1.88