Leveraging Explainable AI to Analyze and Improve Student Engagement in Virtual Learning Environment
Student behavior in online learning reflects their level of engagement with the learning process. Student engagement predictions are conducted to identify students with low engagement so that interventions can be implemented to improve it, as lack of engagement can affect final grades, material retention, and dropout rates. However, the system is still limited to providing prediction results because the machine learning architecture used is a "Black Box". Although accurate predictions, high accuracy is not the only important factor in the model's success. Trust in the model is also crucial, where students and teachers need to understand the reasoning behind the predictions so that the results can be explained and interpreted. This research uses three classification models, namely Random Forest, XGBoost, and SVM, with prediction results ranging from 97% to 99%. The Explainable AI (XAI) techniques used are SHAP and LIME. SHAP focuses on global explanations, while LIME focuses on local explanations. The results show that the explanations using SHAP and LIME are consistent both globally and locally for Random Forest and XGBoost, but slightly different for SVM, due to the different characteristics of the models.
Authors
- Dade Nurjanah (ORCID: https://orcid.org/0000-0001-9318-8409)
- Kusuma Ayu Laksitowening (ORCID: https://orcid.org/0000-0002-5337-0318)
- Hetti Hidayati
- Suyanto Suyanto (ORCID: https://orcid.org/0000-0003-2262-030X)
Institutions
- Telkom University (ID)
Publication Details
- Published
- 2024-12-11
- DOI
- https://doi.org/10.1109/isriti64779.2024.10963394
- Primary Topic
- Online Learning and Analytics
- Type
- article
- Field-Weighted Citation Impact
- 0.00