Integrating Ensemble Learning with Item Response Theory to Improve the Interpretability of Student Learning Outcome Tracing

Student learning outcome (SLO) tracing aims to monitor students’ learning progress by predicting their likelihood of passing or failing courses using Deep Knowledge Tracing (DKT). However, conventional DKT models often lack interpretability, limiting their adoption in educational settings that require transparent decision-making. To address this challenge, this quantitative study proposes an interpretable ensemble framework that integrates Item Response Theory (IRT) with DKT. Specifically, multiple IRT-based DKT models are developed to capture student ability and item characteristics, and these models are combined using a bagging strategy to enhance predictive performance and robustness. The framework is evaluated on an SLO tracing dataset from Prairie View A&M University (PVAMU), a historically Black college and university (HBCU). Result analysis includes comparisons of evaluation metrics such as Area Under the Curve (AUC), accuracy (ACC), and precision across individual and ensemble models, as well as visualizations of student ability, item difficulty, and predicted probabilities to assess interpretability. Experimental results demonstrate that the ensemble approach consistently outperforms single models while providing clear, interpretable insights into student learning dynamics. These findings suggest that integrating ensemble methods with IRT can simultaneously improve prediction accuracy and transparency in SLO tracing.

Authors

Institutions

Publication Details

Journal
Applied Sciences
Published
2025-11-27
DOI
https://doi.org/10.3390/app152312594
Primary Topic
Intelligent Tutoring Systems and Adaptive Learning
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Integrating Ensemble Learning with Item Response Theory to Improve the Interpretability of Student Learning Outcome Tracing

Xishuang Dong, Pamela Obiomon, Lijun Qian, Christian Onyeke
Applied Sciences
Intelligent Tutoring Systems and Adaptive Learning
article

Integrating Ensemble Learning with Item Response Theory to Improve the Interpretability of Student Learning Outcome Tracing

Xishuang Dong, Pamela Obiomon, Lijun Qian, Christian Onyeke
article en

Abstract

Student learning outcome (SLO) tracing aims to monitor students’ learning progress by predicting their likelihood of passing or failing courses using Deep Knowledge Tracing (DKT). However, conventional DKT models often lack interpretability, limiting their adoption in educational settings that require transparent decision-making. To address this challenge, this quantitative study proposes an interpretable ensemble framework that integrates Item Response Theory (IRT) with DKT. Specifically, multiple IRT-based DKT models are developed to capture student ability and item characteristics, and these models are combined using a bagging strategy to enhance predictive performance and robustness. The framework is evaluated on an SLO tracing dataset from Prairie View A&M University (PVAMU), a historically Black college and university (HBCU). Result analysis includes comparisons of evaluation metrics such as Area Under the Curve (AUC), accuracy (ACC), and precision across individual and ensemble models, as well as visualizations of student ability, item difficulty, and predicted probabilities to assess interpretability. Experimental results demonstrate that the ensemble approach consistently outperforms single models while providing clear, interpretable insights into student learning dynamics. These findings suggest that integrating ensemble methods with IRT can simultaneously improve prediction accuracy and transparency in SLO tracing.

Applied SciencesVol. 15(23)
Prairie View A&M University (US)
Openalex Percentile: Top 80%
Intelligent Tutoring Systems and Adaptive Learning
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.