TibetanQA2.0: Dataset with Unanswerable Questions for Tibetan Machine Reading Comprehension

How to improve the metacognition abilities of the models is a hot topic in Machine Reading Comprehension (MRC), a dataset with unanswerable questions is an effective way to test the abilities. There are many datasets with unanswerable questions for MRC in Chinese and English, but the related research in low-resource languages such as Tibetan is in initial progress. TibetanQA is an extractive dataset with answerable questions for MRC in Tibetan, which contains 20,000 question-and-answer pairs and 1,513 articles, but this dataset mainly focuses on answerable questions, which models trained on this dataset may produce less accurate predictions when encountering questions that do not have a precise answer in the text. To address these weaknesses, this paper constructs the Dataset with Unanswerable Questions for Tibetan Machine Reading Comprehension (TibetanQA2.0). This dataset was constructed by crowd workers, and contains 505 passages and 1,347 unanswerable question-and-answer pairs. The passages cover six topics, which are geography, biology, history, nature, culture, and medicine. The dataset’s quality was ensured by unifying the use of interrogative particles, correcting spelling and grammar errors, and verifying its compatibility with the Tibetan context.

Authors

Publication Details

Journal
Data Intelligence
Published
2024-08-26
DOI
https://doi.org/10.3724/2096-7004.di.2024.0029
Citations
3
Primary Topic
Natural Language Processing Techniques
Type
article
Field-Weighted Citation Impact
1.04

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

TibetanQA2.0: Dataset with Unanswerable Questions for Tibetan Machine Reading Comprehension

Zhengcuo Dan, Yuan Sun
3 citations
Data Intelligence
Natural Language Processing Techniques
1.04
article

TibetanQA2.0: Dataset with Unanswerable Questions for Tibetan Machine Reading Comprehension

Zhengcuo Dan, Yuan Sun
article en
3 citations

Abstract

How to improve the metacognition abilities of the models is a hot topic in Machine Reading Comprehension (MRC), a dataset with unanswerable questions is an effective way to test the abilities. There are many datasets with unanswerable questions for MRC in Chinese and English, but the related research in low-resource languages such as Tibetan is in initial progress. TibetanQA is an extractive dataset with answerable questions for MRC in Tibetan, which contains 20,000 question-and-answer pairs and 1,513 articles, but this dataset mainly focuses on answerable questions, which models trained on this dataset may produce less accurate predictions when encountering questions that do not have a precise answer in the text. To address these weaknesses, this paper constructs the Dataset with Unanswerable Questions for Tibetan Machine Reading Comprehension (TibetanQA2.0). This dataset was constructed by crowd workers, and contains 505 passages and 1,347 unanswerable question-and-answer pairs. The passages cover six topics, which are geography, biology, history, nature, culture, and medicine. The dataset’s quality was ensured by unifying the use of interrogative particles, correcting spelling and grammar errors, and verifying its compatibility with the Tibetan context.

Data IntelligenceVol. 6(4)
Minzu University of China, National Social Science Fund of China
Quality Education
Openalex Percentile: Top 19%
Natural Language Processing Techniques
1.04
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.