Evaluating the Accuracy of Large Language Models in Pharmaceutical Calculations: A Comparison of ChatGPT and MathGPT
While demonstrating some capability, the 70% accuracy of ChatGPT 3.5 and MathGPT Unlimited, coupled with fundamental calculation errors, indicates they are insufficiently accurate for sole use in pharmaceutical calculations. These findings highlight the imperative for pharmacy educators to emphasize foundational skills and teach critical evaluation of artificial intelligence-generated responses.
Authors
- Chenxiang Zhang
- Bernadette Cornelison (ORCID: https://orcid.org/0000-0002-4970-571X)
- A. Middleton (ORCID: https://orcid.org/0000-0002-9508-4117)
- Brian L. Erstad (ORCID: https://orcid.org/0000-0001-8909-9921)
- Christopher J. Edwards (ORCID: https://orcid.org/0000-0001-7312-7684)
- Jon Ove Hagen
- Julia Halloran
Institutions
- University of Arizona (US)
Publication Details
- Journal
- American Journal of Pharmaceutical Education
- Published
- 2025-11-27
- DOI
- https://doi.org/10.1016/j.ajpe.2025.101910
- Citations
- 1
- Primary Topic
- Artificial Intelligence in Healthcare and Education
- Type
- article
- Field-Weighted Citation Impact
- 0.65