AI-Powered Personal Tutors as a Scalable Solution to the 2-Sigma Problem in Pharmacy Education
Background: The “2 Sigma Problem”, where individualized tutoring outperforms conventional instruction by two standard deviations, remains a persistent challenge in large-enrollment pharmacy courses. Generative AI tutors, constrained to instructor-verified content, offer a scalable, equitable approximation of personalized support. Methods: Four course-specific AI tutors were deployed across first-year (P1; n = 108–119/cohort) and third-year (P3; n = 98–108/cohort) Doctor of Pharmacy cohorts (Fall 2024–Spring 2026) using ChatGPT-4o and PlayLab with retrieval-augmented generation. Effectiveness was evaluated through longitudinal grade analysis, American Association of Colleges of Pharmacy proficiency outcomes, satisfaction surveys, and anonymized interaction log analysis. Results: Engagement was heterogeneous across curricular formats: 15-week P1 courses supported sustained weekly usage for foundational concept reinforcement, whereas 4-week P3 modules exhibited lower, targeted utilization focused on rapid self-assessment. In P1 Biochemistry, tutor integration was associated with longitudinal cohort exam improvements. The overall targeted metabolism exam mean rose from 74.0% (Fall 2023, no AI) to 81.4% (Fall 2024, AI tutor) and 83.6% (Fall 2025, AI tutor), with active users (n = 16, 85%, Fall 2024) outperforming non-users (n = 16, 79.3%, Fall 2024) by 5.7 percentage points, and with higher mean scores observed across progressively higher usage tiers. AACP proficiency means increased from 77.9% to 82.1%, exceeding the 80% benchmark. In P1 Physiology and P3 modules, cohort performance remained consistently high (83.7–88.2%), maintaining AACP benchmark proficiency across all observation cycles. Student perceptions were positive regarding conceptual clarification and adaptive explanations. Conclusions: Curriculum-aligned AI tutors represent a viable strategy for approximating individualized instruction in pharmacy courses. Course-specific AI tutors demonstrate feasibility across PharmD curricula, functioning as continuous retrieval-practice tools in foundational sciences and as targeted self-assessment aids in accelerated modules. Educational benefits and adoption dynamics are moderated by curricular pace, subject complexity, and assessment structures, highlighting key considerations for broader health sciences implementation.
Authors
- Maria Victoria Tejada-Simon (ORCID: https://orcid.org/0000-0002-3632-9188)
Institutions
- University of Houston (US)
Publication Details
- Journal
- Pharmacy
- Published
- 2026-10-14
- DOI
- https://doi.org/10.3390/pharmacy14070151
- Primary Topic
- Artificial Intelligence in Healthcare and Education
- Type
- article
- Field-Weighted Citation Impact
- 0.00