AI-Powered Personal Tutors as a Scalable Solution to the 2-Sigma Problem in Pharmacy Education

Background: The “2 Sigma Problem”, where individualized tutoring outperforms conventional instruction by two standard deviations, remains a persistent challenge in large-enrollment pharmacy courses. Generative AI tutors, constrained to instructor-verified content, offer a scalable, equitable approximation of personalized support. Methods: Four course-specific AI tutors were deployed across first-year (P1; n = 108–119/cohort) and third-year (P3; n = 98–108/cohort) Doctor of Pharmacy cohorts (Fall 2024–Spring 2026) using ChatGPT-4o and PlayLab with retrieval-augmented generation. Effectiveness was evaluated through longitudinal grade analysis, American Association of Colleges of Pharmacy proficiency outcomes, satisfaction surveys, and anonymized interaction log analysis. Results: Engagement was heterogeneous across curricular formats: 15-week P1 courses supported sustained weekly usage for foundational concept reinforcement, whereas 4-week P3 modules exhibited lower, targeted utilization focused on rapid self-assessment. In P1 Biochemistry, tutor integration was associated with longitudinal cohort exam improvements. The overall targeted metabolism exam mean rose from 74.0% (Fall 2023, no AI) to 81.4% (Fall 2024, AI tutor) and 83.6% (Fall 2025, AI tutor), with active users (n = 16, 85%, Fall 2024) outperforming non-users (n = 16, 79.3%, Fall 2024) by 5.7 percentage points, and with higher mean scores observed across progressively higher usage tiers. AACP proficiency means increased from 77.9% to 82.1%, exceeding the 80% benchmark. In P1 Physiology and P3 modules, cohort performance remained consistently high (83.7–88.2%), maintaining AACP benchmark proficiency across all observation cycles. Student perceptions were positive regarding conceptual clarification and adaptive explanations. Conclusions: Curriculum-aligned AI tutors represent a viable strategy for approximating individualized instruction in pharmacy courses. Course-specific AI tutors demonstrate feasibility across PharmD curricula, functioning as continuous retrieval-practice tools in foundational sciences and as targeted self-assessment aids in accelerated modules. Educational benefits and adoption dynamics are moderated by curricular pace, subject complexity, and assessment structures, highlighting key considerations for broader health sciences implementation.

Authors

Institutions

Publication Details

Journal
Pharmacy
Published
2026-10-14
DOI
https://doi.org/10.3390/pharmacy14070151
Primary Topic
Artificial Intelligence in Healthcare and Education
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

AI-Powered Personal Tutors as a Scalable Solution to the 2-Sigma Problem in Pharmacy Education

Maria Victoria Tejada-Simon
Pharmacy
Artificial Intelligence in Healthcare and Education
article

AI-Powered Personal Tutors as a Scalable Solution to the 2-Sigma Problem in Pharmacy Education

Maria Victoria Tejada-Simon
article en

Abstract

Background: The “2 Sigma Problem”, where individualized tutoring outperforms conventional instruction by two standard deviations, remains a persistent challenge in large-enrollment pharmacy courses. Generative AI tutors, constrained to instructor-verified content, offer a scalable, equitable approximation of personalized support. Methods: Four course-specific AI tutors were deployed across first-year (P1; n = 108–119/cohort) and third-year (P3; n = 98–108/cohort) Doctor of Pharmacy cohorts (Fall 2024–Spring 2026) using ChatGPT-4o and PlayLab with retrieval-augmented generation. Effectiveness was evaluated through longitudinal grade analysis, American Association of Colleges of Pharmacy proficiency outcomes, satisfaction surveys, and anonymized interaction log analysis. Results: Engagement was heterogeneous across curricular formats: 15-week P1 courses supported sustained weekly usage for foundational concept reinforcement, whereas 4-week P3 modules exhibited lower, targeted utilization focused on rapid self-assessment. In P1 Biochemistry, tutor integration was associated with longitudinal cohort exam improvements. The overall targeted metabolism exam mean rose from 74.0% (Fall 2023, no AI) to 81.4% (Fall 2024, AI tutor) and 83.6% (Fall 2025, AI tutor), with active users (n = 16, 85%, Fall 2024) outperforming non-users (n = 16, 79.3%, Fall 2024) by 5.7 percentage points, and with higher mean scores observed across progressively higher usage tiers. AACP proficiency means increased from 77.9% to 82.1%, exceeding the 80% benchmark. In P1 Physiology and P3 modules, cohort performance remained consistently high (83.7–88.2%), maintaining AACP benchmark proficiency across all observation cycles. Student perceptions were positive regarding conceptual clarification and adaptive explanations. Conclusions: Curriculum-aligned AI tutors represent a viable strategy for approximating individualized instruction in pharmacy courses. Course-specific AI tutors demonstrate feasibility across PharmD curricula, functioning as continuous retrieval-practice tools in foundational sciences and as targeted self-assessment aids in accelerated modules. Educational benefits and adoption dynamics are moderated by curricular pace, subject complexity, and assessment structures, highlighting key considerations for broader health sciences implementation.

PharmacyVol. 14(7)
University of Houston (US)
Quality education, Good health and well-being
Openalex Percentile: Top 20%
Artificial Intelligence in Healthcare and Education
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.