Leveraging In-Context Learning and Retrieval-Augmented Generation for Automatic Question Generation in Educational Domains

Question generation in education is a time-consuming and cognitively demanding task, as it requires creating questions that are both contextually relevant and pedagogically sound.Current automated question generation methods often generate questions that are out of context.In this work, we explore advanced techniques for automated question generation in educational contexts, focusing on In-Context Learning (ICL), Retrieval-Augmented Generation (RAG), and a novel Hybrid Model that merges both methods.We implement GPT-4 for ICL using few-shot examples and BART with a retrieval module for RAG.The Hybrid Model combines RAG and ICL to address these issues and improve question quality.Evaluation is conducted using automated metrics, followed by human evaluation metrics.Our results show that both the ICL approach and the Hybrid Model consistently outperform other methods, including baseline models, by generating more contextually accurate and relevant questions.

Authors

Institutions

Publication Details

Published
2024-12-12
DOI
https://doi.org/10.1145/3734947.3734949
Citations
5
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
1.74

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Leveraging In-Context Learning and Retrieval-Augmented Generation for Automatic Question Generation in Educational Domains

Sudeshna Sarkar, Aniket Deroy, Subhankar Maity
5 citations
Topic Modeling
1.74
article

Leveraging In-Context Learning and Retrieval-Augmented Generation for Automatic Question Generation in Educational Domains

Sudeshna Sarkar, Aniket Deroy, Subhankar Maity
article en
5 citations

Abstract

Question generation in education is a time-consuming and cognitively demanding task, as it requires creating questions that are both contextually relevant and pedagogically sound.Current automated question generation methods often generate questions that are out of context.In this work, we explore advanced techniques for automated question generation in educational contexts, focusing on In-Context Learning (ICL), Retrieval-Augmented Generation (RAG), and a novel Hybrid Model that merges both methods.We implement GPT-4 for ICL using few-shot examples and BART with a retrieval module for RAG.The Hybrid Model combines RAG and ICL to address these issues and improve question quality.Evaluation is conducted using automated metrics, followed by human evaluation metrics.Our results show that both the ICL approach and the Hybrid Model consistently outperform other methods, including baseline models, by generating more contextually accurate and relevant questions.

Indian Institute of Technology Kharagpur (IN)
Ministry of Education, India, Division of Human Resource Development
Quality Education
Openalex Percentile: Top 12%
Topic Modeling
1.74
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.