Explainable multimodal learning analytics for model-based counterfactual decision support using literature-calibrated synthetic data

Predictive learning analytics can identify students who are at risk of failing, however, there is a lack of information to guide advisors on what they should do. This paper proposes an end-to-end synthetic framework using eight structured indicators of Learning Management System (LMS) and an aggregated VADER sentiment. The XGBoost pipeline model had accuracy of 80.7%, precision of 76.5%, recall of 90.3%, an F1 score of 0.828, and an ROC-AUC score of 0.905 at the fixed cut-point of 0.28; logistic regression had the best ROC-AUC score of 0.930. With sentiment removal, the accuracy of XGBoost dropped to 76.7% and the value of ROC-AUC to 0.875. The constrained greedy counterfactual search screened 149 XGBoost cases separately, dropped 80 cases (53.7\%) below the target of 0.40, and reduced the score by a mean of 33.3% points. Threshold crossing rate for logistic regression and random forest were 100.0% and 41.4% respectively with the same search, highlighting model dependence. A 27-configuration, training-only sensitivity analysis placed the fixed XGBoost configuration 12th by five-fold cross-validated ROC-AUC (0.929), compared with 0.933 for the best configuration. DiCE-random crossed the target for 74.5% of the same XGBoost-screened cases but required larger normalized changes and approximately four times the runtime of greedy search. These results characterize a reconstructed synthetic model and its search procedures; they do not establish educational validity, causal effectiveness, calibrated institutional risk, least-burden recourse, or deployment readiness.

Authors

Institutions

Publication Details

Journal
Scientific Reports
Published
2026-11-06
DOI
https://doi.org/10.1038/s41598-026-72995-w
Primary Topic
Online Learning and Analytics
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Explainable multimodal learning analytics for model-based counterfactual decision support using literature-calibrated synthetic data

Abhishek Dadhich, Anita Venugopal, Dinesh Goyal, Fatima Abdul Munaim Al Rawas et al.
2 links
Scientific Reports
Online Learning and Analytics
article

Explainable multimodal learning analytics for model-based counterfactual decision support using literature-calibrated synthetic data

Abhishek Dadhich, Anita Venugopal, Dinesh Goyal, Fatima Abdul Munaim Al Rawas, Ali Omar Al Minhali
article en

Abstract

Predictive learning analytics can identify students who are at risk of failing, however, there is a lack of information to guide advisors on what they should do. This paper proposes an end-to-end synthetic framework using eight structured indicators of Learning Management System (LMS) and an aggregated VADER sentiment. The XGBoost pipeline model had accuracy of 80.7%, precision of 76.5%, recall of 90.3%, an F1 score of 0.828, and an ROC-AUC score of 0.905 at the fixed cut-point of 0.28; logistic regression had the best ROC-AUC score of 0.930. With sentiment removal, the accuracy of XGBoost dropped to 76.7% and the value of ROC-AUC to 0.875. The constrained greedy counterfactual search screened 149 XGBoost cases separately, dropped 80 cases (53.7\%) below the target of 0.40, and reduced the score by a mean of 33.3% points. Threshold crossing rate for logistic regression and random forest were 100.0% and 41.4% respectively with the same search, highlighting model dependence. A 27-configuration, training-only sensitivity analysis placed the fixed XGBoost configuration 12th by five-fold cross-validated ROC-AUC (0.929), compared with 0.933 for the best configuration. DiCE-random crossed the target for 74.5% of the same XGBoost-screened cases but required larger normalized changes and approximately four times the runtime of greedy search. These results characterize a reconstructed synthetic model and its search procedures; they do not establish educational validity, causal effectiveness, calibrated institutional risk, least-burden recourse, or deployment readiness.

Scientific Reports
Dhofar University (OM), Poornima Institute of Engineering and Technology (IN)
Quality education
Openalex Percentile: Top 12%
Online Learning and Analytics
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon