Leakage-Free, Explainable and Fairness-Aware Early Prediction of At-Risk Students: A Temporal Validation Study on the Open University Learning Analytics Dataset

Early identification of students at risk of failing or withdrawing enables timely intervention, yet many published predictors are evaluated with random splits, test-set tuning and accuracy-centred metrics that overstate deployable performance. This study proposes a leakage-free, explainable and fairness-aware early-warning framework evaluated on the Open University Learning Analytics Dataset (32,593 enrolments). Models were trained on three earlier course presentations and tested on an unseen later presentation, using only information available on each prediction day. Eight classifiers were tuned with student-grouped cross-validation. At day 60, LightGBM achieved a ROC-AUC of 0.813 and a PR-AUC of 0.761 and identified 75.3% of at-risk students; ROC-AUC rose from 0.72 at course start to 0.90 at day 150. Assessment behaviour accounted for 47% of SHAP attributions. A fairness audit revealed disparities across deprivation and prior-education groups. A replication on the UCI Student Performance data confirmed that early academic signals outweigh demographic predictors.

Authors

Institutions

Publication Details

Journal
International Journal of Research in Interdisciplinary Studies
Published
2026-11-14
DOI
https://doi.org/10.65138/ijris.2026.v4i11.386
Primary Topic
Online Learning and Analytics
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Leakage-Free, Explainable and Fairness-Aware Early Prediction of At-Risk Students: A Temporal Validation Study on the Open University Learning Analytics Dataset

Md Selim Mia, Mohammed Abdullah Ahmed Baroom
International Journal of Research in Interdisciplinary Studies
Online Learning and Analytics
article

Leakage-Free, Explainable and Fairness-Aware Early Prediction of At-Risk Students: A Temporal Validation Study on the Open University Learning Analytics Dataset

Md Selim Mia, Mohammed Abdullah Ahmed Baroom
article en

Abstract

Early identification of students at risk of failing or withdrawing enables timely intervention, yet many published predictors are evaluated with random splits, test-set tuning and accuracy-centred metrics that overstate deployable performance. This study proposes a leakage-free, explainable and fairness-aware early-warning framework evaluated on the Open University Learning Analytics Dataset (32,593 enrolments). Models were trained on three earlier course presentations and tested on an unseen later presentation, using only information available on each prediction day. Eight classifiers were tuned with student-grouped cross-validation. At day 60, LightGBM achieved a ROC-AUC of 0.813 and a PR-AUC of 0.761 and identified 75.3% of at-risk students; ROC-AUC rose from 0.72 at course start to 0.90 at day 150. Assessment behaviour accounted for 47% of SHAP attributions. A fairness audit revealed disparities across deprivation and prior-education groups. A replication on the UCI Student Performance data confirmed that early academic signals outweigh demographic predictors.

International Journal of Research in Interdisciplinary StudiesVol. 4(11)
Nanjing University of Information Science and Technology (CN)
Online Learning and Analytics
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon