Knowledge Retrieval-Based Intelligent Question and Answer Generation Framework for Education

The paper introduces a Knowledge Retrieval-Based Intelligent Question and Answer Generation Framework for Education, leveraging Retrieval Augmented Generation (RAG) to enhance Large Language Models (LLMs) in producing high-quality, contextually relevant examination questions and answers across subjects. The framework addresses challenges in ensuring comprehensive subject coverage, educational standards, and evaluation metrics. Key components include Optical Character Recognition (OCR), data chunking, vectorization using multilingual BERT, and custom retrieval functions. The RAG system's effectiveness is evaluated using the RAGAs metric, covering metrics like faithfulness, answer relevancy, context recall, and context precision. Comparative results reveal OpenAI models surpassing Google's Gemini in coherence and context relevance due to differing architectures and training methods. Concluding, the paper highlights potential for both large and small language models in tailored educational applications, noting limitations such as hallucinations, high resource demands, and contextual drift.

Authors

Institutions

Publication Details

Journal
Journal of Student Research
Published
2025-02-28
DOI
https://doi.org/10.47611/jsrhs.v14i1.8684
Primary Topic
Educational Technology and Assessment
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Knowledge Retrieval-Based Intelligent Question and Answer Generation Framework for Education

Sunil Kumar Roy, Anay Pardasani, Karen Maleski
Journal of Student Research
Educational Technology and Assessment
article

Knowledge Retrieval-Based Intelligent Question and Answer Generation Framework for Education

Sunil Kumar Roy, Anay Pardasani, Karen Maleski
article en

Abstract

The paper introduces a Knowledge Retrieval-Based Intelligent Question and Answer Generation Framework for Education, leveraging Retrieval Augmented Generation (RAG) to enhance Large Language Models (LLMs) in producing high-quality, contextually relevant examination questions and answers across subjects. The framework addresses challenges in ensuring comprehensive subject coverage, educational standards, and evaluation metrics. Key components include Optical Character Recognition (OCR), data chunking, vectorization using multilingual BERT, and custom retrieval functions. The RAG system's effectiveness is evaluated using the RAGAs metric, covering metrics like faithfulness, answer relevancy, context recall, and context precision. Comparative results reveal OpenAI models surpassing Google's Gemini in coherence and context relevance due to differing architectures and training methods. Concluding, the paper highlights potential for both large and small language models in tailored educational applications, noting limitations such as hallucinations, high resource demands, and contextual drift.

Journal of Student ResearchVol. 14(1)
Prospect Park Hospital (GB)
Openalex Percentile: Top 67%
Educational Technology and Assessment
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.