A dataset of multi-type reasoning question answering (MTR-QA)

<p indent="0mm">Considering the problems that large language models are prone to experiencing logical confusion and insufficient ability to capture of implicit relationships when dealing with complex reasoning tasks, this paper proposes and constructs a high-quality dataset of multi-type reasoning question answering dataset (MTR-QA). By collecting and sorting the past <sc>15 years</sc> of civil service examination questions and authoritative mock question banks, a multi-stage text processing framework including text standardisation, hash deduplication, near-duplicate detection and semantic embedding similarity filtering was used to achieve data cleaning, which effectively reduces redundancy and noise interference. To ensure the reliability of the data, this paper designs a multi-model evaluation mechanism integrating GPT-4, DeepSeek-V1 and Qwen-2.5, which quantitatively evaluates the data across four dimensions: integrity (CPL), accuracy (ACC), security (SFC) and chain of thought quality (CoT-Q). In the end, 24,312 high-quality data entries were selected and stored in json format with a size of 34.1 MB. Each data sample contains six attributes: question, options, answer, chain of thought, type, and level of difficulty, and is divided into four core types of reasoning: logic, semantics, mathematics and comprehensive knowledge reasoning. The MTR-QA dataset has been expanded in terms of reasoning types and topic breadth, providing a reliable data base for various reasoning tasks such as pre-training large language models, supervised fine-tuning and model evaluation, and promote the performance improvement of large language models in complex reasoning and Q&amp;A scenarios.

Authors

Publication Details

Journal
China Scientific Data
Published
2026-02-24
DOI
https://doi.org/10.11922/11-6035.csd.2025.0062.zh
Citations
1
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
52.10
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A dataset of multi-type reasoning question answering (MTR-QA)

Wenshe Wu, Qiang WANG, Ning MA, Yingjie LI et al.
1 citations
China Scientific Data
Topic Modeling
52.10
article

A dataset of multi-type reasoning question answering (MTR-QA)

Wenshe Wu, Qiang WANG, Ning MA, Yingjie LI, Chenglin JIANG
article en
1 citations

Abstract

<p indent="0mm">Considering the problems that large language models are prone to experiencing logical confusion and insufficient ability to capture of implicit relationships when dealing with complex reasoning tasks, this paper proposes and constructs a high-quality dataset of multi-type reasoning question answering dataset (MTR-QA). By collecting and sorting the past <sc>15 years</sc> of civil service examination questions and authoritative mock question banks, a multi-stage text processing framework including text standardisation, hash deduplication, near-duplicate detection and semantic embedding similarity filtering was used to achieve data cleaning, which effectively reduces redundancy and noise interference. To ensure the reliability of the data, this paper designs a multi-model evaluation mechanism integrating GPT-4, DeepSeek-V1 and Qwen-2.5, which quantitatively evaluates the data across four dimensions: integrity (CPL), accuracy (ACC), security (SFC) and chain of thought quality (CoT-Q). In the end, 24,312 high-quality data entries were selected and stored in json format with a size of 34.1 MB. Each data sample contains six attributes: question, options, answer, chain of thought, type, and level of difficulty, and is divided into four core types of reasoning: logic, semantics, mathematics and comprehensive knowledge reasoning. The MTR-QA dataset has been expanded in terms of reasoning types and topic breadth, providing a reliable data base for various reasoning tasks such as pre-training large language models, supervised fine-tuning and model evaluation, and promote the performance improvement of large language models in complex reasoning and Q&amp;A scenarios.

China Scientific DataVol. 11(1)
Openalex Percentile: Top 0%
Topic Modeling
52.10
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

A dataset of multi-type reasoning question answering (MTR-QA) — Wenshe Wu, Qiang WANG, et al. · China Scientific Data (2026) | TGRS Research Map | TGRS