Transformers in Bangla Text: Advancing MCQ and Answer Generation Methods

Multiple-choice questions (MCQs) serve as a vital tool in educational assessments, not only in competitive exams but also in technology-driven learning environments. However, automating the generation of high-quality MCQs from Bangla text presents a complex challenge due to the language’s intricate grammar, contextual dependencies, and limited resources for natural language processing. While significant progress has been made in automatic MCQ generation for other languages, no substantial work has addressed Bangla, leaving a critical gap in the literature. In this research, we present a novel approach for generating MCQs along with correct answers from Bangla text using transformer-based models, trained on a dataset of 10,135 MCQs from 2,024 passages. Among various models, the fine-tuned Llama-3.1-8B model showcased superior efficacy, achieving success rate of 93.5% in generating relevant MCQs and 100% accuracy in generating the correct answers demonstrating key features such as contextual integrity, syntactic correctness, and relevance of both questions and distractors. This approach outperforms existing models in other languages, providing a robust solution for MCQ generation in Bangla text.

Authors

Institutions

Publication Details

Published
2024-12-20
DOI
https://doi.org/10.1109/iccit64611.2024.11021706
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Transformers in Bangla Text: Advancing MCQ and Answer Generation Methods

Muntasir Mamun, Mohammad Shahidur Rahman
Topic Modeling
article

Transformers in Bangla Text: Advancing MCQ and Answer Generation Methods

Muntasir Mamun, Mohammad Shahidur Rahman
article en

Abstract

Multiple-choice questions (MCQs) serve as a vital tool in educational assessments, not only in competitive exams but also in technology-driven learning environments. However, automating the generation of high-quality MCQs from Bangla text presents a complex challenge due to the language’s intricate grammar, contextual dependencies, and limited resources for natural language processing. While significant progress has been made in automatic MCQ generation for other languages, no substantial work has addressed Bangla, leaving a critical gap in the literature. In this research, we present a novel approach for generating MCQs along with correct answers from Bangla text using transformer-based models, trained on a dataset of 10,135 MCQs from 2,024 passages. Among various models, the fine-tuned Llama-3.1-8B model showcased superior efficacy, achieving success rate of 93.5% in generating relevant MCQs and 100% accuracy in generating the correct answers demonstrating key features such as contextual integrity, syntactic correctness, and relevance of both questions and distractors. This approach outperforms existing models in other languages, providing a robust solution for MCQ generation in Bangla text.

Shahjalal University of Science and Technology (BD)
Openalex Percentile: Top 72%
Topic Modeling
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Transformers in Bangla Text: Advancing MCQ and Answer Generation Methods — Muntasir Mamun, Mohammad Shahidur Rahman · (2024) | TGRS Research Map | TGRS