Leveraging Explainable AI to Analyze and Improve Student Engagement in Virtual Learning Environment

Student behavior in online learning reflects their level of engagement with the learning process. Student engagement predictions are conducted to identify students with low engagement so that interventions can be implemented to improve it, as lack of engagement can affect final grades, material retention, and dropout rates. However, the system is still limited to providing prediction results because the machine learning architecture used is a "Black Box". Although accurate predictions, high accuracy is not the only important factor in the model's success. Trust in the model is also crucial, where students and teachers need to understand the reasoning behind the predictions so that the results can be explained and interpreted. This research uses three classification models, namely Random Forest, XGBoost, and SVM, with prediction results ranging from 97% to 99%. The Explainable AI (XAI) techniques used are SHAP and LIME. SHAP focuses on global explanations, while LIME focuses on local explanations. The results show that the explanations using SHAP and LIME are consistent both globally and locally for Random Forest and XGBoost, but slightly different for SVM, due to the different characteristics of the models.

Authors

Institutions

Publication Details

Published
2024-12-11
DOI
https://doi.org/10.1109/isriti64779.2024.10963394
Primary Topic
Online Learning and Analytics
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Leveraging Explainable AI to Analyze and Improve Student Engagement in Virtual Learning Environment

Dade Nurjanah, Kusuma Ayu Laksitowening, Hetti Hidayati, Suyanto Suyanto
Online Learning and Analytics
article

Leveraging Explainable AI to Analyze and Improve Student Engagement in Virtual Learning Environment

Dade Nurjanah, Kusuma Ayu Laksitowening, Hetti Hidayati, Suyanto Suyanto
article en

Abstract

Student behavior in online learning reflects their level of engagement with the learning process. Student engagement predictions are conducted to identify students with low engagement so that interventions can be implemented to improve it, as lack of engagement can affect final grades, material retention, and dropout rates. However, the system is still limited to providing prediction results because the machine learning architecture used is a "Black Box". Although accurate predictions, high accuracy is not the only important factor in the model's success. Trust in the model is also crucial, where students and teachers need to understand the reasoning behind the predictions so that the results can be explained and interpreted. This research uses three classification models, namely Random Forest, XGBoost, and SVM, with prediction results ranging from 97% to 99%. The Explainable AI (XAI) techniques used are SHAP and LIME. SHAP focuses on global explanations, while LIME focuses on local explanations. The results show that the explanations using SHAP and LIME are consistent both globally and locally for Random Forest and XGBoost, but slightly different for SVM, due to the different characteristics of the models.

Telkom University (ID)
Openalex Percentile: Top 69%
Online Learning and Analytics
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Leveraging Explainable AI to Analyze and Improve Student Engagement in Virtual Learning Environment — Dade Nurjanah, Kusuma Ayu Laksitowening, et al. · (2024) | TGRS Research Map | TGRS