A dataset of challenging mathematical problems for reasoning large language models: SD1K

<p indent="0mm">To address the lack of insufficient challenging training data for reasoning large language models, this study constructs a challenging mathematics dataset for reasoning, termed SD1K, using a methodology that integrates concept extraction and model synthesis. The dataset is built upon a collection of 7,500 training samples from the Sky-T1-32B-Preview model, from which 9,054 mathematical concept entities are extracted. Each concept entity includes a formal definition, application scenarios, and usage example. Using large language models, new mathematical problems are generated by randomly sampling these entities, with long-form reasoning chains and corresponding answers automatically constructed for each problem. A filtering process combining predefined rules and model-based verification is applied to select 1,000 high-quality and challenging mathematical problems, forming the final SD1K dataset. The SD1K dataset provides a valuable resource for the training and evaluation of large language models in reasoning tasks and contributes to the advancement of model performance in complex inference scenarios.

Authors

Publication Details

Journal
China Scientific Data
Published
2026-03-01
DOI
https://doi.org/10.11922/11-6035.csd.2025.0120.zh
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A dataset of challenging mathematical problems for reasoning large language models: SD1K

Danhao Zhu, Fei Huang
China Scientific Data
Topic Modeling
article

A dataset of challenging mathematical problems for reasoning large language models: SD1K

Danhao Zhu, Fei Huang
article en

Abstract

<p indent="0mm">To address the lack of insufficient challenging training data for reasoning large language models, this study constructs a challenging mathematics dataset for reasoning, termed SD1K, using a methodology that integrates concept extraction and model synthesis. The dataset is built upon a collection of 7,500 training samples from the Sky-T1-32B-Preview model, from which 9,054 mathematical concept entities are extracted. Each concept entity includes a formal definition, application scenarios, and usage example. Using large language models, new mathematical problems are generated by randomly sampling these entities, with long-form reasoning chains and corresponding answers automatically constructed for each problem. A filtering process combining predefined rules and model-based verification is applied to select 1,000 high-quality and challenging mathematical problems, forming the final SD1K dataset. The SD1K dataset provides a valuable resource for the training and evaluation of large language models in reasoning tasks and contributes to the advancement of model performance in complex inference scenarios.

China Scientific Data
Quality Education
Openalex Percentile: Top 5%
Topic Modeling
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.