Associations between voluntary engagement with faculty-developed, clinically oriented formative questions and content-matched examination performance in preclinical microbiology: an observational mixed-methods cohort study

Abstract Background Formative practice questions may support retrieval, knowledge application, and self-regulated learning. However, there is limited evidence regarding voluntary engagement with faculty-developed, clinically oriented questions aligned with course assessments. This study aimed to examine the associations between engagement with faculty-developed formative microbiology questions and content-matched examination performance among first-year osteopathic medical students and explored students’ perceptions of these resources. Methods This quantitative-priority, observational mixed-methods cohort study was conducted at a US osteopathic medical school during the 2025–2026 academic year. The quantitative analyses included 314 students with complete engagement and examination data. Students voluntarily accessed 174 faculty-developed, clinically oriented multiple-choice questions across 11 microbiology topics through InteDashboard, with explanatory feedback provided after each attempt. Engagement was measured as the percentage of questions completed, and the primary outcome was performance on corresponding summative examination items. Associations were primarily examined via Pearson correlation, simple linear regression, and analysis of variance. Deidentified responses to two instructor evaluation questions were thematically analyzed and integrated with quantitative findings. Results The students completed a mean of 128.3 ± 47.6 questions (73.7 ± 27.4%), and the mean examination performance was 79.4 ± 11.1%. Engagement was positively associated with examination performance (r = 0.448, p < 0.001), accounting for 20.1% of the observed variance (R² = 0.201). Each additional question completed was associated with 0.037 additional correct examination items (95% CI: 0.0285–0.0448; p < 0.001). Mean performance increased across the low-, moderate-, and high-engagement groups (71.8%, 78.0%, and 84.0%, respectively; p < 0.001). Positive associations were observed across all 11 topics after correction for multiple comparisons. Thematic analysis of 72 eligible anonymous response records identified four themes: assessment readiness and curricular alignment; reinforcement and application of knowledge; metacognitive calibration and explanatory feedback; and conditions affecting educational value. Conclusions Greater voluntary engagement with faculty-developed, clinically oriented formative microbiology questions was associated with higher performance on content-matched summative examination items. The students’ perceptions provided complementary insights into the resource’s educational value. Although causality cannot be inferred from this observational study, the findings support the potential educational value of thoughtfully designed, curriculum-aligned formative-question resources in preclinical medical education.

Authors

Institutions

Publication Details

Journal
Research Square
Published
2026-11-16
DOI
https://doi.org/10.21203/rs.3.rs-11260168/v1
Primary Topic
Innovations in Medical Education
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

Associations between voluntary engagement with faculty-developed, clinically oriented formative questions and content-matched examination performance in preclinical microbiology: an observational mixed-methods cohort study

Hari Prasad Nepal
Research Square
Innovations in Medical Education
preprint

Associations between voluntary engagement with faculty-developed, clinically oriented formative questions and content-matched examination performance in preclinical microbiology: an observational mixed-methods cohort study

Hari Prasad Nepal
preprint en

Abstract

Abstract Background Formative practice questions may support retrieval, knowledge application, and self-regulated learning. However, there is limited evidence regarding voluntary engagement with faculty-developed, clinically oriented questions aligned with course assessments. This study aimed to examine the associations between engagement with faculty-developed formative microbiology questions and content-matched examination performance among first-year osteopathic medical students and explored students’ perceptions of these resources. Methods This quantitative-priority, observational mixed-methods cohort study was conducted at a US osteopathic medical school during the 2025–2026 academic year. The quantitative analyses included 314 students with complete engagement and examination data. Students voluntarily accessed 174 faculty-developed, clinically oriented multiple-choice questions across 11 microbiology topics through InteDashboard, with explanatory feedback provided after each attempt. Engagement was measured as the percentage of questions completed, and the primary outcome was performance on corresponding summative examination items. Associations were primarily examined via Pearson correlation, simple linear regression, and analysis of variance. Deidentified responses to two instructor evaluation questions were thematically analyzed and integrated with quantitative findings. Results The students completed a mean of 128.3 ± 47.6 questions (73.7 ± 27.4%), and the mean examination performance was 79.4 ± 11.1%. Engagement was positively associated with examination performance (r = 0.448, p < 0.001), accounting for 20.1% of the observed variance (R² = 0.201). Each additional question completed was associated with 0.037 additional correct examination items (95% CI: 0.0285–0.0448; p < 0.001). Mean performance increased across the low-, moderate-, and high-engagement groups (71.8%, 78.0%, and 84.0%, respectively; p < 0.001). Positive associations were observed across all 11 topics after correction for multiple comparisons. Thematic analysis of 72 eligible anonymous response records identified four themes: assessment readiness and curricular alignment; reinforcement and application of knowledge; metacognitive calibration and explanatory feedback; and conditions affecting educational value. Conclusions Greater voluntary engagement with faculty-developed, clinically oriented formative microbiology questions was associated with higher performance on content-matched summative examination items. The students’ perceptions provided complementary insights into the resource’s educational value. Although causality cannot be inferred from this observational study, the findings support the potential educational value of thoughtfully designed, curriculum-aligned formative-question resources in preclinical medical education.

Research Square
Philadelphia College of Osteopathic Medicine (US), Alabama College of Osteopathic Medicine (US), Burrell College of Osteopathic Medicine (US)
Quality education, Good health and well-being
Innovations in Medical Education
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon