A Two-Stage Approach to Detecting Differential Item Functioning: Combining Regularization with the Mantel–Haenszel Method (Reg-MH)

Test bias is a critical concern in educational and psychological measurement. Differential item functioning (DIF) is widely used to identify potential test bias. Although regularization methods have shown promise in DIF detection, interpreting the resulting DIF parameters remains challenging. This study proposes a two-stage approach, termed Reg-MH, that combines regularization with the Mantel–Haenszel (MH) method. Specifically, regularization is first used to select anchor items, followed by MH testing to identify DIF items, combining the anchor selection advantages of regularization with the interpretability of MH. A pilot simulation study examined alternative regularization-based anchor selection strategies and the number of anchor items. A main simulation study evaluated the performance of Reg-MH against traditional MH and regularized DIF (Reg-DIF) methods across varying sample sizes, DIF magnitudes, DIF proportions, and ability distributions. An empirical illustration using PISA 2012 data further demonstrated its practical application. The simulation results showed that Reg-MH generally achieved a more favorable balance between Type I error control and statistical power than the competing methods. Compared with traditional MH, Reg-MH reduced Type I error rates while maintaining higher statistical power than Reg-DIF. Type I error rates generally increased with sample size, DIF magnitude, and DIF proportion, whereas statistical power increased with sample size and DIF magnitude but decreased as DIF proportion increased. Overall, Reg-MH provides a promising approach to DIF detection by integrating regularization-based anchor selection with conventional statistical testing.

Authors

Institutions

Publication Details

Journal
Applied Psychological Measurement
Published
2026-11-14
DOI
https://doi.org/10.1177/01466216261506348
Primary Topic
Psychometric Methodologies and Testing
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

A Two-Stage Approach to Detecting Differential Item Functioning: Combining Regularization with the Mantel–Haenszel Method (Reg-MH)

Hongyun Liu, Kaiyu Gan
Applied Psychological Measurement
Psychometric Methodologies and Testing
article

A Two-Stage Approach to Detecting Differential Item Functioning: Combining Regularization with the Mantel–Haenszel Method (Reg-MH)

Hongyun Liu, Kaiyu Gan
article en

Abstract

Test bias is a critical concern in educational and psychological measurement. Differential item functioning (DIF) is widely used to identify potential test bias. Although regularization methods have shown promise in DIF detection, interpreting the resulting DIF parameters remains challenging. This study proposes a two-stage approach, termed Reg-MH, that combines regularization with the Mantel–Haenszel (MH) method. Specifically, regularization is first used to select anchor items, followed by MH testing to identify DIF items, combining the anchor selection advantages of regularization with the interpretability of MH. A pilot simulation study examined alternative regularization-based anchor selection strategies and the number of anchor items. A main simulation study evaluated the performance of Reg-MH against traditional MH and regularized DIF (Reg-DIF) methods across varying sample sizes, DIF magnitudes, DIF proportions, and ability distributions. An empirical illustration using PISA 2012 data further demonstrated its practical application. The simulation results showed that Reg-MH generally achieved a more favorable balance between Type I error control and statistical power than the competing methods. Compared with traditional MH, Reg-MH reduced Type I error rates while maintaining higher statistical power than Reg-DIF. Type I error rates generally increased with sample size, DIF magnitude, and DIF proportion, whereas statistical power increased with sample size and DIF magnitude but decreased as DIF proportion increased. Overall, Reg-MH provides a promising approach to DIF detection by integrating regularization-based anchor selection with conventional statistical testing.

Applied Psychological Measurement
Beijing Normal University (CN)
Psychometric Methodologies and Testing
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon