Context-Aware MCQ Generation with Large Language Models: A Novel Framework

The methods of conducting examinations are evolving with institutions increasingly adopting online systems, making Multiple-Choice Questions (MCQs) important due to their efficiency and scalability. However, constructing high-quality MCQs remains a manual, time-consuming process. Existing automated systems, mainly using BERT-based summarization and lexical distractor generation, such as WordNet, to suffer from limited contextual understanding and scalability. To address these challenges, this research proposes an innovative solution using Large Language Models (LLMs), specifically Gemini AI, for automated MCQ generation. The methodology involves LLM-based text summarization to extract key concepts, followed by direct MCQ and distractor generation with enhanced contextual relevance, diversity, and minimal manual intervention. Additionally, real-time feedback and adaptive difficulty adjustment are integrated to enhance personalized learning experiences. Comparative analysis with recent models like T5, GPT-3.5, and BERT shows that Gemini AI outperforms them in contextual quality, distractor coherence, and generation efficiency, achieving a 20% improvement in human-rated question quality, thus highlighting the potential of LLMs to revolutionize automated assessment design.

Authors

Institutions

Publication Details

Journal
Journal of Information Technology and Digital World
Published
2025-05-06
DOI
https://doi.org/10.36548/jitdw.2025.2.001
Citations
2
Primary Topic
Semantic Web and Ontologies
Type
article
Field-Weighted Citation Impact
4.96
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Context-Aware MCQ Generation with Large Language Models: A Novel Framework

M. Maheswari, K. Vimala Devi, Singapogu Ravikiran B., K. Anusha et al.
2 citations
Journal of Information Technology and Digital World
Semantic Web and Ontologies
4.96
article

Context-Aware MCQ Generation with Large Language Models: A Novel Framework

M. Maheswari, K. Vimala Devi, Singapogu Ravikiran B., K. Anusha, Naga Likhitha N.
article en
2 citations

Abstract

The methods of conducting examinations are evolving with institutions increasingly adopting online systems, making Multiple-Choice Questions (MCQs) important due to their efficiency and scalability. However, constructing high-quality MCQs remains a manual, time-consuming process. Existing automated systems, mainly using BERT-based summarization and lexical distractor generation, such as WordNet, to suffer from limited contextual understanding and scalability. To address these challenges, this research proposes an innovative solution using Large Language Models (LLMs), specifically Gemini AI, for automated MCQ generation. The methodology involves LLM-based text summarization to extract key concepts, followed by direct MCQ and distractor generation with enhanced contextual relevance, diversity, and minimal manual intervention. Additionally, real-time feedback and adaptive difficulty adjustment are integrated to enhance personalized learning experiences. Comparative analysis with recent models like T5, GPT-3.5, and BERT shows that Gemini AI outperforms them in contextual quality, distractor coherence, and generation efficiency, achieving a 20% improvement in human-rated question quality, thus highlighting the potential of LLMs to revolutionize automated assessment design.

Journal of Information Technology and Digital WorldVol. 7(2)
Jawaharlal Nehru Technological University, Kakinada (IN)
Openalex Percentile: Top 5%
Semantic Web and Ontologies
4.96
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Context-Aware MCQ Generation with Large Language Models: A Novel Framework — M. Maheswari, K. Vimala Devi, et al. · Journal of Information Technology and Digital World (2025) | TGRS Research Map | TGRS