From Prediction to Support: Explainable Machine Learning and Rule-Based Interventions for Identifying Students at Academic Risk

Early identification of students at risk of academic failure may enable institutions to offer timely and proportionate support. This study developed and compared three supervised classification models, XGBoost, Random Forest and Decision Tree, and linked their predictions to a prototype rule-based intervention dashboard. A public synthetic student-performance dataset containing 6,607 records was preprocessed by imputing missing values and encoding categorical variables. Academic risk was defined by an examination-score threshold, with scores below 65 classified as high risk and scores of 65 or above as low risk. Data were divided into 80% for training and 20% for testing. Models were assessed using accuracy, precision, recall, F1-score, confusion matrices and area under the receiver operating characteristic curve. SHAP values were used to examine the direction and relative importance of predictors. XGBoost achieved the strongest test performance, with 0.92 accuracy, 0.92 weighted precision, 0.92 weighted recall, 0.92 weighted F1-score and an AUC-ROC of 0.976. Random Forest achieved 0.91 accuracy and an AUC-ROC of 0.965, while Decision Tree achieved 0.83 accuracy and an AUC-ROC of 0.809. For the high-risk class, XGBoost produced a precision of 0.89 and recall of 0.86. Across the models, hours studied, attendance, and previous scores were the most influential features. These informed a Power BI prototype that paired risk classifications with suggested support. Findings show technical feasibility of combining explainable prediction with recommendations. However, because the dataset is synthetic, results do not establish effectiveness in a university population. External validation, fairness assessment, and human oversight are required before operational use.

Authors

Institutions

Publication Details

Journal
Nexus Science Review
Published
2026-11-13
DOI
https://doi.org/10.66104/sxxfns69
Primary Topic
Online Learning and Analytics
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

From Prediction to Support: Explainable Machine Learning and Rule-Based Interventions for Identifying Students at Academic Risk

Jo-Anne Tait, Chika Judith Abolle-Okoyeagu, Aminat Salami Adebayo
2 links
Nexus Science Review
Online Learning and Analytics
article

From Prediction to Support: Explainable Machine Learning and Rule-Based Interventions for Identifying Students at Academic Risk

Jo-Anne Tait, Chika Judith Abolle-Okoyeagu, Aminat Salami Adebayo
article en

Abstract

Early identification of students at risk of academic failure may enable institutions to offer timely and proportionate support. This study developed and compared three supervised classification models, XGBoost, Random Forest and Decision Tree, and linked their predictions to a prototype rule-based intervention dashboard. A public synthetic student-performance dataset containing 6,607 records was preprocessed by imputing missing values and encoding categorical variables. Academic risk was defined by an examination-score threshold, with scores below 65 classified as high risk and scores of 65 or above as low risk. Data were divided into 80% for training and 20% for testing. Models were assessed using accuracy, precision, recall, F1-score, confusion matrices and area under the receiver operating characteristic curve. SHAP values were used to examine the direction and relative importance of predictors. XGBoost achieved the strongest test performance, with 0.92 accuracy, 0.92 weighted precision, 0.92 weighted recall, 0.92 weighted F1-score and an AUC-ROC of 0.976. Random Forest achieved 0.91 accuracy and an AUC-ROC of 0.965, while Decision Tree achieved 0.83 accuracy and an AUC-ROC of 0.809. For the high-risk class, XGBoost produced a precision of 0.89 and recall of 0.86. Across the models, hours studied, attendance, and previous scores were the most influential features. These informed a Power BI prototype that paired risk classifications with suggested support. Findings show technical feasibility of combining explainable prediction with recommendations. However, because the dataset is synthetic, results do not establish effectiveness in a university population. External validation, fairness assessment, and human oversight are required before operational use.

Nexus Science ReviewVol. 1(06 - November)
Robert Gordon University (GB)
Quality education, Good health and well-being
Online Learning and Analytics
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon