Evaluating Data-Minimized Early-Warning Systems for Educator Decision Support: Evidence Across Review Capacities and Educational Stages
Educational early-warning systems rank students for review when support capacity is limited. We examined how removing background information changes retrospective review-list performance in the Open University Learning Analytics Dataset (OULAD) and two separately analyzed UCI education datasets. Full-information models were compared with reduced-input models across several educational stages and four review capacities (5%, 10%, 20%, and 30%). The primary outcome was the difference in review-list precision, with paired bootstrap intervals adjusted across stages and capacities within each policy family. Sex/gender removal showed no statistically detectable difference after this adjustment; this does not establish equivalence. Removing socioeconomic/family information reduced whole-cohort predictive performance in OULAD and UCI 697 and reduced precision in selected larger OULAD lists and at UCI 697 enrollment. UCI 320 estimates were inconclusive. Some adjusted precision findings varied across calibration methods. Diagnostic models showed that excluded attributes remained partly predictable from retained records. These post-development analyses evaluate predictive performance, not causal effects on educator workload, interventions, or student outcomes. The findings support evaluating data minimization at the intended educational stage and review capacity, while separately assessing whole-cohort performance and list membership. Prospective evaluation with educators and students is needed before drawing conclusions about educational benefit.
Authors
- Alexandr Alexandrovich Kuznetsov (ORCID: https://orcid.org/0000-0003-2331-6326)
- Gulmira Shangytbayeva (ORCID: https://orcid.org/0000-0003-4615-5756)
- Kainizhamal Iklassova (ORCID: https://orcid.org/0000-0002-8330-4282)
- Aigul Kayrulaevna Shaikhanova (ORCID: https://orcid.org/0000-0001-6006-4813)
- Dana Tyulemissova (ORCID: https://orcid.org/0009-0006-5319-7742)
- Камила Сериковна Бакенова (ORCID: https://orcid.org/0009-0004-2567-173X)
Institutions
- L. N. Gumilyov Eurasian National University (KZ)
- University of Illinois Urbana-Champaign (US)
- Università degli Studi eCampus (IT)
- Aktobe Regional State University named after K.Zhubanov (KZ)
- Arkalyk State Pedagogical Institute named after Ibrai Altynsarin (KZ)
- Astana IT University (KZ)
- V. N. Karazin Kharkiv National University (UA)
- Manash Kozybayev North Kazakhstan University (KZ)
Publication Details
- Journal
- Education Sciences
- Published
- 2026-10-28
- DOI
- https://doi.org/10.3390/educsci16111816
- Primary Topic
- Online Learning and Analytics
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Ministry of Science and Higher Education of the Republic of Kazakhstan