Comparing Game-Based and Virtual Objective Structured Clinical Examination Formats: Perceived Fairness and Achievement Emotions in Clinical Competency Examinations for Low- and Middle-Income Countries
Assessment formats shape not only what is measured, but also how examinees experience high-stakes evaluation. While Objective Structured Clinical Examinations (OSCEs) remain a cornerstone of clinical competency assessment, they can induce anxiety and raise concerns about fairness. Digital game-based assessment (DGBA) offers an alternative interaction paradigm in which assessment is embedded within a standardized digital environment. Focusing on perceived fairness and test-related achievement emotions, we conducted a mixed-methods study comparing a DGBA platform (ENTRUST) and virtual OSCEs during a high-stakes surgical certification examination involving trainees across sub-Saharan Africa. Quantitative findings showed that ENTRUST was associated with lower test-related anxiety, higher enjoyment, and stronger perceptions of fairness, objectivity, and absence of bias than virtual OSCEs. Qualitative findings helped explain these differences by showing how assessment interaction characteristics such as evaluator presence, pacing, structured autonomy, feedback visibility, and interaction structure shaped examinees’ perceptions of control and consistency. Together, these findings highlight assessment as an interaction design problem, suggesting that differences in emotions and perceived fairness arise not simply from assessment content or game elements but from the broader interaction design of assessments. We conclude with implications for designing DGBAs for professional training and certification.
Authors
- Katherine D. Arnow (ORCID: https://orcid.org/0000-0001-6118-3312)
- Abebe Bekele (ORCID: https://orcid.org/0000-0003-0018-9096)
- Edward Franklin Melcer (ORCID: https://orcid.org/0000-0003-1760-5279)
- Cara A. Liebert (ORCID: https://orcid.org/0000-0002-5848-9895)
- Jason Tsai
- Dana T. Lin (ORCID: https://orcid.org/0000-0001-8470-2189)
- Seno Saruni (ORCID: https://orcid.org/0000-0002-7814-4421)
- Michael Mwachiro (ORCID: https://orcid.org/0000-0002-3779-5324)
- Andrew Friedman (ORCID: https://orcid.org/0009-0008-1003-8826)
- Peiqi Chen
- Hanna Getachew
- Alexa Aracelis Engel (ORCID: https://orcid.org/0009-0006-0290-0143)
- Daniel Logan (ORCID: https://orcid.org/0009-0001-7186-8988)
Institutions
- Howard University (US)
- University of Global Health Equity (RW)
- Indiana University School of Medicine (US)
- Carleton University (CA)
- Stanford University (US)
Publication Details
- Journal
- Proceedings of the ACM on Human-Computer Interaction
- Published
- 2026-11-03
- DOI
- https://doi.org/10.1145/3831334
- Primary Topic
- Educational Games and Gamification
- Type
- article
- Field-Weighted Citation Impact
- 0.00