Expert and LLM Evaluation of LearnShield: A Generative AI Recomnadation Application in E-Learning Environments

With the increasing demand for e-learning systems in educational contexts, and the constant interactions with them in day-to-day learning activities, there is a high demand for dynamic approaches that will facilitate the provision of cybersecurity recommendations to e-learning stakeholders. Thus, the objective of this researcher is to develop and evaluate LearnShield, a GenAI recommender tool that can used by educators and students to generate context-specific user-oriented recommendations. The study evaluates this application using a mixed method approach where human and LLM-based evaluators assess the application considering multiple metrics. The results indicate the overall positive assessment of LearnShield as well as its potential in the field of cybersecurity awareness.