A Two-Stage Approach to Detecting Differential Item Functioning: Combining Regularization with the Mantel–Haenszel Method (Reg-MH)
Test bias is a critical concern in educational and psychological measurement. Differential item functioning (DIF) is widely used to identify potential test bias. Although regularization methods have shown promise in DIF detection, interpreting the resulting DIF parameters remains challenging. This study proposes a two-stage approach, termed Reg-MH, that combines regularization with the Mantel–Haenszel (MH) method. Specifically, regularization is first used to select anchor items, followed by MH testing to identify DIF items, combining the anchor selection advantages of regularization with the interpretability of MH. A pilot simulation study examined alternative regularization-based anchor selection strategies and the number of anchor items. A main simulation study evaluated the performance of Reg-MH against traditional MH and regularized DIF (Reg-DIF) methods across varying sample sizes, DIF magnitudes, DIF proportions, and ability distributions. An empirical illustration using PISA 2012 data further demonstrated its practical application. The simulation results showed that Reg-MH generally achieved a more favorable balance between Type I error control and statistical power than the competing methods. Compared with traditional MH, Reg-MH reduced Type I error rates while maintaining higher statistical power than Reg-DIF. Type I error rates generally increased with sample size, DIF magnitude, and DIF proportion, whereas statistical power increased with sample size and DIF magnitude but decreased as DIF proportion increased. Overall, Reg-MH provides a promising approach to DIF detection by integrating regularization-based anchor selection with conventional statistical testing.
Authors
- Hongyun Liu (ORCID: https://orcid.org/0000-0002-3472-9102)
- Kaiyu Gan (ORCID: https://orcid.org/0009-0009-0745-9918)
Institutions
- Beijing Normal University (CN)
Publication Details
- Journal
- Applied Psychological Measurement
- Published
- 2026-11-14
- DOI
- https://doi.org/10.1177/01466216261506348
- Primary Topic
- Psychometric Methodologies and Testing
- Type
- article
- Field-Weighted Citation Impact
- 0.00