Maintaining methodological rigor in language assessment: A response to Randall et al.’s justice-oriented antiracist validity framework

Recent proposals to reorient validity theory toward justice through a Justice-oriented Antiracist Validity (JAV) framework have sparked vigorous debate in educational and language assessment. While the JAV approach seeks to disrupt systemic inequities by centering antiracist principles and critical quantitative methodologies, its rejection of traditional validity models raises profound philosophical and methodological concerns. In this viewpoint, we respond to Randall et al. by arguing that maintaining rigorous, falsifiable approaches to validation remains essential for meaningful progress toward fairness and justice. We examine historical, ethical, and methodological limitations of the JAV framework, highlight practical challenges in operationalizing its principles across diverse contexts, and question the viability of QuantCrit as an analytic stance. We conclude by advocating for a pluralistic, collaborative profession that acknowledges critical perspectives without abandoning the methodological rigor essential for equitable assessment.

Authors

Institutions

Publication Details

Journal
Language Testing
Published
2026-02-03
DOI
https://doi.org/10.1177/02655322261416901
Primary Topic
Psychometric Methodologies and Testing
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Maintaining methodological rigor in language assessment: A response to Randall et al.’s justice-oriented antiracist validity framework

Nathaniel Owen, Haiyan Xu
Language Testing
Psychometric Methodologies and Testing
article

Maintaining methodological rigor in language assessment: A response to Randall et al.’s justice-oriented antiracist validity framework

Nathaniel Owen, Haiyan Xu
article en

Abstract

Recent proposals to reorient validity theory toward justice through a Justice-oriented Antiracist Validity (JAV) framework have sparked vigorous debate in educational and language assessment. While the JAV approach seeks to disrupt systemic inequities by centering antiracist principles and critical quantitative methodologies, its rejection of traditional validity models raises profound philosophical and methodological concerns. In this viewpoint, we respond to Randall et al. by arguing that maintaining rigorous, falsifiable approaches to validation remains essential for meaningful progress toward fairness and justice. We examine historical, ethical, and methodological limitations of the JAV framework, highlight practical challenges in operationalizing its principles across diverse contexts, and question the viability of QuantCrit as an analytic stance. We conclude by advocating for a pluralistic, collaborative profession that acknowledges critical perspectives without abandoning the methodological rigor essential for equitable assessment.

Language Testing
University of Leicester (GB), Oxford University Press (United Kingdom) (GB)
Peace, Justice and strong institutions
Openalex Percentile: Top 70%
Psychometric Methodologies and Testing
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.