Evaluating e-learning readiness using explainable machine learning and key organizational change factors in higher education

E-learning readiness (ELR) is critical for implementing digital education strategies, particularly in developing countries where online learning faces unique challenges. This study aims to provide a concise and actionable framework for assessing and predicting ELR in Algerian universities by combining the ADKAR model with advanced machine learning algorithms and Shapley Additive Explanations (SHAP). Data were collected through semi-structured interviews and questionnaires from 530 students and professors across Algerian universities, focusing on the five ADKAR factors: Awareness, Desire, Knowledge, Ability, and Reinforcement. Eight machine learning models were employed to analyze the data, selected for their ability to manage complex, high-dimensional datasets and capture non-linear relationships: k-nearest neighbors, support vector machines, partial least squares, random forests, gradient boosting, decision trees, CatBoost, and XGBoost. Results show that ensemble methods CatBoost and XGBoost achieving the best predictive performance ( $$R^{2}$$ = 0.811), reflecting their ability to explain the variance in ELR. SHAP analysis identified “Ability” as the most influential factor, followed by “Desire” and “Reinforcement.” This combination of SHAP and ADKAR provides novel insights by highlighting critical areas for intervention, such as enhancing digital skills and promoting knowledge acquisition. The use of SHAP in this study enhances model interpretability, enabling stakeholders to identify the most impactful factors and implement targeted, effective interventions to address key barriers to e-learning readiness.

Authors

Institutions

Publication Details

Journal
Education and Information Technologies
Published
2025-01-16
DOI
https://doi.org/10.1007/s10639-025-13335-9
Citations
7
Primary Topic
Online Learning and Analytics
Type
article
Field-Weighted Citation Impact
11.86

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Evaluating e-learning readiness using explainable machine learning and key organizational change factors in higher education

Mohammed Terbeche, Fouzi Harrou, Ying Sun, Mohamed Zine
7 citations
Education and Information Technologies
Online Learning and Analytics
11.86
article

Evaluating e-learning readiness using explainable machine learning and key organizational change factors in higher education

Mohammed Terbeche, Fouzi Harrou, Ying Sun, Mohamed Zine
article en
7 citations

Abstract

E-learning readiness (ELR) is critical for implementing digital education strategies, particularly in developing countries where online learning faces unique challenges. This study aims to provide a concise and actionable framework for assessing and predicting ELR in Algerian universities by combining the ADKAR model with advanced machine learning algorithms and Shapley Additive Explanations (SHAP). Data were collected through semi-structured interviews and questionnaires from 530 students and professors across Algerian universities, focusing on the five ADKAR factors: Awareness, Desire, Knowledge, Ability, and Reinforcement. Eight machine learning models were employed to analyze the data, selected for their ability to manage complex, high-dimensional datasets and capture non-linear relationships: k-nearest neighbors, support vector machines, partial least squares, random forests, gradient boosting, decision trees, CatBoost, and XGBoost. Results show that ensemble methods CatBoost and XGBoost achieving the best predictive performance ( $$R^{2}$$ = 0.811), reflecting their ability to explain the variance in ELR. SHAP analysis identified “Ability” as the most influential factor, followed by “Desire” and “Reinforcement.” This combination of SHAP and ADKAR provides novel insights by highlighting critical areas for intervention, such as enhancing digital skills and promoting knowledge acquisition. The use of SHAP in this study enhances model interpretability, enabling stakeholders to identify the most impactful factors and implement targeted, effective interventions to address key barriers to e-learning readiness.

Education and Information TechnologiesVol. 30(9)
King Abdullah University of Science and Technology (SA)
King Abdullah University of Science and Technology
Openalex Percentile: Top 2%
Online Learning and Analytics
11.86
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Evaluating e-learning readiness using explainable machine learning and key organizational change factors in higher education — Mohammed Terbeche, Fouzi Harrou, et al. · Education and Information Technologies (2025) | TGRS Research Map | TGRS