Using multilabel classification neural network to detect intersectional <scp>DIF</scp> with small sample sizes

This study introduces InterDIFNet, a multilabel classification neural network for detecting intersectional differential item functioning (DIF) in educational and psychological assessments, with a focus on small sample sizes. Unlike traditional marginal DIF methods, which often fail to capture the effects of intersecting identities and require large samples, InterDIFNet models uniform and non-uniform DIF across multiple intersectional groups simultaneously and utilizes an optimized thresholding procedure to balance power and Type 1 error control. A Monte Carlo simulation compared InterDIFNet to the Truncated Lasso Penalty (TLP) test and other intersectional DIF methods across varying sample sizes, numbers of groups and DIF prevalence rates. Results show that when trained using TLP features, InterDIFNet consistently achieved higher power than TLP while maintaining comparable Type 1 error control, particularly in scenarios with three or more intersectional groups. An empirical application to real assessment data further demonstrated the method's practical utility. InterDIFNet provides a scalable, data-driven solution for identifying intersectional DIF across multiple small sample groups.

Authors

Institutions

Publication Details

Journal
British Journal of Mathematical and Statistical Psychology
Published
2026-03-13
DOI
https://doi.org/10.1111/bmsp.70041
Primary Topic
Psychometric Methodologies and Testing
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Using multilabel classification neural network to detect intersectional DIF with small sample sizes

Yale Quan, Chun Wang
British Journal of Mathematical and Statistical Psychology
Psychometric Methodologies and Testing
article

Using multilabel classification neural network to detect intersectional DIF with small sample sizes

Yale Quan, Chun Wang
article en

Abstract

This study introduces InterDIFNet, a multilabel classification neural network for detecting intersectional differential item functioning (DIF) in educational and psychological assessments, with a focus on small sample sizes. Unlike traditional marginal DIF methods, which often fail to capture the effects of intersecting identities and require large samples, InterDIFNet models uniform and non-uniform DIF across multiple intersectional groups simultaneously and utilizes an optimized thresholding procedure to balance power and Type 1 error control. A Monte Carlo simulation compared InterDIFNet to the Truncated Lasso Penalty (TLP) test and other intersectional DIF methods across varying sample sizes, numbers of groups and DIF prevalence rates. Results show that when trained using TLP features, InterDIFNet consistently achieved higher power than TLP while maintaining comparable Type 1 error control, particularly in scenarios with three or more intersectional groups. An empirical application to real assessment data further demonstrated the method's practical utility. InterDIFNet provides a scalable, data-driven solution for identifying intersectional DIF across multiple small sample groups.

British Journal of Mathematical and Statistical Psychology
University of Washington (US)
Quality Education
Openalex Percentile: Top 27%
Psychometric Methodologies and Testing
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.