Comparing Scoring Methods for Situational Judgment Tests in International Student Selection: Examinations of Criterion‐Related Validity and Ethnic Subgroup Differences

ABSTRACT Situational judgment tests (SJTs) are increasingly recognized as effective tools for student selection in higher education. However, no research has examined how scoring methods affect the validity and fairness of SJTs for students, especially in international settings. This study aims to evaluate how different scoring methods affect the criterion‐related validity of student SJTs and the ethnic subgroup differences. A total of 311 students from universities in the U.S. and China completed the student SJTs. The findings reveal that mode consensus and proportion consensus exhibit relatively higher criterion‐related validity than traditional scoring methods. However, dichotomous consensus performed better than other scoring methods, including mode consensus and proportion consensus in reducing subgroup differences. The study provides valuable insights for enhancing the validity and fairness of SJTs in student selection processes across cultural contexts.

Authors

Institutions

Publication Details

Journal
International Journal of Selection and Assessment
Published
2025-12-26
DOI
https://doi.org/10.1111/ijsa.70036
Primary Topic
Medical Education and Admissions
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Comparing Scoring Methods for Situational Judgment Tests in International Student Selection: Examinations of Criterion‐Related Validity and Ethnic Subgroup Differences

Qingxiong Weng, Haonan Li
International Journal of Selection and Assessment
Medical Education and Admissions
article

Comparing Scoring Methods for Situational Judgment Tests in International Student Selection: Examinations of Criterion‐Related Validity and Ethnic Subgroup Differences

Qingxiong Weng, Haonan Li
article en

Abstract

ABSTRACT Situational judgment tests (SJTs) are increasingly recognized as effective tools for student selection in higher education. However, no research has examined how scoring methods affect the validity and fairness of SJTs for students, especially in international settings. This study aims to evaluate how different scoring methods affect the criterion‐related validity of student SJTs and the ethnic subgroup differences. A total of 311 students from universities in the U.S. and China completed the student SJTs. The findings reveal that mode consensus and proportion consensus exhibit relatively higher criterion‐related validity than traditional scoring methods. However, dichotomous consensus performed better than other scoring methods, including mode consensus and proportion consensus in reducing subgroup differences. The study provides valuable insights for enhancing the validity and fairness of SJTs in student selection processes across cultural contexts.

International Journal of Selection and AssessmentVol. 34(1)
University of Science and Technology of China (CN), Vanke (China) (CN)
Quality Education
Openalex Percentile: Top 26%
Medical Education and Admissions
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.