Multiple-Choice Question Generation in Low Resource Indonesian Language with T5

Question plays a significant role in the teaching-learning process.However, preparing the questions and assessing each question manually is time-consuming.One type of question, Multiple Choice questions (MCQs) has recently become an active field of research.While studies in this field are not relatively new, they have predominantly focused on the English Language.Currently, there is limited research dedicated to generating MCQs in the Indonesian language.In this study, we propose an end-to-end Indonesian Multiple-Choice Question system that utilises the Textto-Text Transfer Transformer (T5) architecture along with exploring Single-Task & Multi-Task.It contains interconnected components: Question Generation (QG), and Distractor Generation (DG).We utilise the pre-trained T5 model and fine-tuned it to our tasks.Moreover, each of the model performance of these models was evaluated by BLEU, ROUGE-L, and an error analysis.In addition, there are 9 different configurations were tested using Humanlevel performance with total of 22 human assessments were involved in this study.The results show that our Indonesian MCQ generation system represents a promising step toward developing high-quality MCQs.The human evaluation of the best-performing configuration yielded the following scores: 1.38/5 (very easy) for difficulty, 3.99/5 (moderate) for clarity, and 2.07/5 (low-to-moderate) for rigidity (where lower is better).

Publication Details

Journal
International journal of intelligent engineering and systems
Published
2025-05-10
DOI
https://doi.org/10.22266/ijies2025.0630.26
Primary Topic
Edcuational Technology Systems
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Multiple-Choice Question Generation in Low Resource Indonesian Language with T5

International journal of intelligent engineering and systems
Edcuational Technology Systems
article

Multiple-Choice Question Generation in Low Resource Indonesian Language with T5

article en

Abstract

Question plays a significant role in the teaching-learning process.However, preparing the questions and assessing each question manually is time-consuming.One type of question, Multiple Choice questions (MCQs) has recently become an active field of research.While studies in this field are not relatively new, they have predominantly focused on the English Language.Currently, there is limited research dedicated to generating MCQs in the Indonesian language.In this study, we propose an end-to-end Indonesian Multiple-Choice Question system that utilises the Textto-Text Transfer Transformer (T5) architecture along with exploring Single-Task & Multi-Task.It contains interconnected components: Question Generation (QG), and Distractor Generation (DG).We utilise the pre-trained T5 model and fine-tuned it to our tasks.Moreover, each of the model performance of these models was evaluated by BLEU, ROUGE-L, and an error analysis.In addition, there are 9 different configurations were tested using Humanlevel performance with total of 22 human assessments were involved in this study.The results show that our Indonesian MCQ generation system represents a promising step toward developing high-quality MCQs.The human evaluation of the best-performing configuration yielded the following scores: 1.38/5 (very easy) for difficulty, 3.99/5 (moderate) for clarity, and 2.07/5 (low-to-moderate) for rigidity (where lower is better).

International journal of intelligent engineering and systemsVol. 18(5)
Openalex Percentile: Top 95%
Edcuational Technology Systems
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.