AI versus human-generated multiple-choice questions for medical education: a cohort study in a high-stakes examination

ChatGPT-4o demonstrates the potential for efficiently generating MCQs but lacks the depth needed for complex assessments. Human review remains essential to ensure quality. Combining AI efficiency with expert oversight could optimise question creation for high-stakes exams, offering a scalable model for medical education that balances time efficiency and content quality.

Authors

Institutions

Publication Details

Journal
BMC Medical Education
Published
2025-02-08
DOI
https://doi.org/10.1186/s12909-025-06796-6
Citations
50
Primary Topic
Clinical Reasoning and Diagnostic Skills
Type
article
Field-Weighted Citation Impact
75.79

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

AI versus human-generated multiple-choice questions for medical education: a cohort study in a high-stakes examination

Chun Tat Lui, Colin A. Graham, Kevin Kei Ching Hung, Alex Kwok-Keung Law et al.
50 citations
BMC Medical Education
Clinical Reasoning and Diagnostic Skills
75.79
article

AI versus human-generated multiple-choice questions for medical education: a cohort study in a high-stakes examination

Chun Tat Lui, Colin A. Graham, Kevin Kei Ching Hung, Alex Kwok-Keung Law, Koon Ho Cheung, Yu Fai Choi, Jerome Lok Tsun So
article en
50 citations

Abstract

ChatGPT-4o demonstrates the potential for efficiently generating MCQs but lacks the depth needed for complex assessments. Human review remains essential to ensure quality. Combining AI efficiency with expert oversight could optimise question creation for high-stakes exams, offering a scalable model for medical education that balances time efficiency and content quality.

BMC Medical EducationVol. 25(1)
Chinese University of Hong Kong (HK), Hong Kong College of Technology (CN), Tseung Kwan O Hospital (CN), Prince of Wales Hospital (CN)
College of Emergency Medicine
Peace, Justice and strong institutions
Openalex Percentile: Top 0%
Clinical Reasoning and Diagnostic Skills
75.79
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.