Enhancing Student Engagement Through AI-Powered Educational Chatbots: A Retrieval-Augmented Generation Approach

Artificial Intelligence (AI) has rapidly advanced, significantly impacting education through personalized learning solutions. This paper presents the development and evaluation of a novel Retrieval-Augmented Generation (RAG) system designed to deliver tailored educational content based on individual learner progress and needs. Leveraging open-source large language models (LLMs) such as Gemma2, Mistral, and Llama3.2, the system ensures transparency, flexibility, and robust data privacy by enabling local hosting within educational institutions. The architecture comprises a Vue.js and Tailwind CSS-based frontend, a Node.js and Ollama Framework-integrated backend, and a PostgreSQL database. Evaluation was conducted in two phases: validating GPT-4o as a reliable automated evaluation tool against human assessments, and assessing the performance of the selected LLMs in generating high-quality learning materials. Results indicate Gemma2 outperforms other models in accuracy, completeness, correctness, and comprehension, while GPT-4o reliably automates content evaluation. This study advances digital educational platforms by integrating state-of-the-art AI technologies with pedagogical principles, enhancing personalized learning experiences.

Authors

Institutions

Publication Details

Published
2024-11-06
DOI
https://doi.org/10.1109/ithet61869.2024.10837678
Citations
5
Primary Topic
AI in Service Interactions
Type
article
Field-Weighted Citation Impact
1.74
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Enhancing Student Engagement Through AI-Powered Educational Chatbots: A Retrieval-Augmented Generation Approach

Felix Golla
5 citations
AI in Service Interactions
1.74
article

Enhancing Student Engagement Through AI-Powered Educational Chatbots: A Retrieval-Augmented Generation Approach

Felix Golla
article en
5 citations

Abstract

Artificial Intelligence (AI) has rapidly advanced, significantly impacting education through personalized learning solutions. This paper presents the development and evaluation of a novel Retrieval-Augmented Generation (RAG) system designed to deliver tailored educational content based on individual learner progress and needs. Leveraging open-source large language models (LLMs) such as Gemma2, Mistral, and Llama3.2, the system ensures transparency, flexibility, and robust data privacy by enabling local hosting within educational institutions. The architecture comprises a Vue.js and Tailwind CSS-based frontend, a Node.js and Ollama Framework-integrated backend, and a PostgreSQL database. Evaluation was conducted in two phases: validating GPT-4o as a reliable automated evaluation tool against human assessments, and assessing the performance of the selected LLMs in generating high-quality learning materials. Results indicate Gemma2 outperforms other models in accuracy, completeness, correctness, and comprehension, while GPT-4o reliably automates content evaluation. This study advances digital educational platforms by integrating state-of-the-art AI technologies with pedagogical principles, enhancing personalized learning experiences.

Technical University of Applied Sciences Würzburg-Schweinfurt (DE)
Quality Education
Openalex Percentile: Top 12%
AI in Service Interactions
1.74
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.