Exploratory Assessment of GPT-4′s Effectiveness in Generating Valid Exam Items in Pharmacy Education
GPT-4 offers a preliminary step toward generating exam content in pharmacy education but has clear limitations that require further investigation and validation. Substantial human oversight and psychometric evaluation are necessary to ensure clinical realism and appropriate difficulty. Future research with larger samples is needed to further validate the effectiveness of artificial intelligence in item generation for high-stakes assessments in pharmacy education.
Authors
- Jeffrey Mucksavage
- Robert J. DiDomenico (ORCID: https://orcid.org/0000-0002-9374-8012)
- Benjamin Shultz (ORCID: https://orcid.org/0009-0002-4703-4286)
- Kristen L. Goliak
Institutions
- Illinois College (US)
- University of Illinois Chicago (US)
- University of Chicago (US)
Publication Details
- Journal
- American Journal of Pharmaceutical Education
- Published
- 2025-04-15
- DOI
- https://doi.org/10.1016/j.ajpe.2025.101405
- Citations
- 5
- Primary Topic
- Artificial Intelligence in Healthcare and Education
- Type
- article
- Field-Weighted Citation Impact
- 3.27