Measuring AI literacy in medical students: scale development and validation within a self-determination theory framework
BACKGROUND: Artificial intelligence (AI) is increasingly integrated into healthcare, making AI literacy an essential competency for medical students. Existing assessments are often generic, lack validation in medical education, and are not grounded in learning theory. This study developed and validated the AI Literacy Scale for Medical Students (ALSMS) within a self-determination theory (SDT) framework. METHODS: = 314). Candidate facets were derived from prior AI literacy instruments and a previously developed framework, then organized according to SDT. EFA refined the first-order structure, and CFA cross-validated the retained structure and compared prespecified first-order and SDT-aligned higher-order models. RESULTS: . Unidimensional and some hierarchical general-factor models showed poorer fit or identification problems, supporting the construct's multidimensionality. CONCLUSIONS: This study provides initial validity evidence for interpreting ALSMS scores as indicators of medical students' AI literacy within an SDT-informed framework. The findings highlight the significance of integrating ethics into autonomy-supportive curricula and underscore the potential utility of ALSMS for curriculum design, advising, and the evaluation of AI literacy initiatives in medical education.
Authors
- Pei-Jan Tsai (ORCID: https://orcid.org/0000-0001-5806-3336)
- Ching Sing Chai (ORCID: https://orcid.org/0000-0002-6298-4813)
- Hung‐Che Lin (ORCID: https://orcid.org/0000-0002-0138-1904)
- Chin-Sheng Lin
- Chin Lin
- Jyh-Chong Liang (ORCID: https://orcid.org/0000-0002-2423-5950)
Institutions
- National Taiwan Normal University (TW)
- Chinese University of Hong Kong (HK)
- National Defense Medical College (JP)
- National Defense Medical Center (TW)
Publication Details
- Journal
- Medical Education Online
- Published
- 2026-05-22
- DOI
- https://doi.org/10.1080/10872981.2026.2675066
- Primary Topic
- Artificial Intelligence in Healthcare and Education
- Type
- article
- Field-Weighted Citation Impact
- 0.00