Research on Automatic Question Generation Methods for Niche Subjects Based on Large Language Models

High-quality question generation is crucial for ensuring the fairness and validity of examinations. To address the challenges of data scarcity and semantic complexity in automatic question generation (AQG) for niche subjects, including the arts, this study develops a domain-specific large language model (LLM) with a three-tiered optimization mechanism, incorporating prompt tuning, knowledge enhancement, and data augmentation. The model's effectiveness was validated through a case study conducted on a calligraphy course. The results showed that the generated questions achieved a usability rate of 91%, whereas the proposed data augmentation strategy expanded the question bank by 132.56%. This work provides both technical solutions and practical reference for automatic question generation methods targeting niche disciplines. The key contributions of this study encompass the creation of an innovative three-tiered optimization framework, the effective integration of external domain knowledge, and an iterative data augmentation approach that enhances question generation for niche subjects. This research offers a technological pathway and serves as a valuable reference for AQG in niche disciplines.

Authors

Institutions

Publication Details

Published
2025-03-14
DOI
https://doi.org/10.1109/iceit64364.2025.10976111
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Research on Automatic Question Generation Methods for Niche Subjects Based on Large Language Models

Feng Zhang, Jun He, Bo Sun, Meng Guo
Topic Modeling
article

Research on Automatic Question Generation Methods for Niche Subjects Based on Large Language Models

Feng Zhang, Jun He, Bo Sun, Meng Guo
article en

Abstract

High-quality question generation is crucial for ensuring the fairness and validity of examinations. To address the challenges of data scarcity and semantic complexity in automatic question generation (AQG) for niche subjects, including the arts, this study develops a domain-specific large language model (LLM) with a three-tiered optimization mechanism, incorporating prompt tuning, knowledge enhancement, and data augmentation. The model's effectiveness was validated through a case study conducted on a calligraphy course. The results showed that the generated questions achieved a usability rate of 91%, whereas the proposed data augmentation strategy expanded the question bank by 132.56%. This work provides both technical solutions and practical reference for automatic question generation methods targeting niche disciplines. The key contributions of this study encompass the creation of an innovative three-tiered optimization framework, the effective integration of external domain knowledge, and an iterative data augmentation approach that enhances question generation for niche subjects. This research offers a technological pathway and serves as a valuable reference for AQG in niche disciplines.

Open University of China (CN), Beijing Normal University (CN)
Open University, National Natural Science Foundation of China, Beijing Normal University, Natural Science Foundation of Guangdong Province
Quality Education
Openalex Percentile: Top 96%
Topic Modeling
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.