UPSC2M: Benchmarking Adaptive Learning from Two Million MCQ Attempts

We present UPSC2M, a large-scale dataset comprising two million multiple-choice question attempts from over 46,000 students, spanning nearly 9,000 questions across seven subject areas.The questions are drawn from the Union Public Service Commission (UPSC) examination, one of India's most competitive and high-stakes assessments.Each attempt includes both response correctness and time taken, enabling fine-grained analysis of learner behavior and question characteristics.Over this dataset, we define two core benchmark tasks: question difficulty estimation and student performance prediction.The first task involves predicting empirical correctness rates using only question text.The second task focuses on predicting the likelihood of a correct response based on prior interactions.We evaluate simple baseline models on both tasks to demonstrate feasibility and establish reference points.Together, the dataset and benchmarks offer a strong foundation for building scalable, personalized educational systems.We release the dataset and code to support further research at the intersection of content understanding, learner modeling, and adaptive assessment: github.com/

Authors

Publication Details

Published
2025-01-01
DOI
https://doi.org/10.18653/v1/2025.bea-1.70
Primary Topic
Intelligent Tutoring Systems and Adaptive Learning
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

UPSC2M: Benchmarking Adaptive Learning from Two Million MCQ Attempts

Kevin Shi, Karttikeya Mangalam
Intelligent Tutoring Systems and Adaptive Learning
article

UPSC2M: Benchmarking Adaptive Learning from Two Million MCQ Attempts

Kevin Shi, Karttikeya Mangalam
article en

Abstract

We present UPSC2M, a large-scale dataset comprising two million multiple-choice question attempts from over 46,000 students, spanning nearly 9,000 questions across seven subject areas.The questions are drawn from the Union Public Service Commission (UPSC) examination, one of India's most competitive and high-stakes assessments.Each attempt includes both response correctness and time taken, enabling fine-grained analysis of learner behavior and question characteristics.Over this dataset, we define two core benchmark tasks: question difficulty estimation and student performance prediction.The first task involves predicting empirical correctness rates using only question text.The second task focuses on predicting the likelihood of a correct response based on prior interactions.We evaluate simple baseline models on both tasks to demonstrate feasibility and establish reference points.Together, the dataset and benchmarks offer a strong foundation for building scalable, personalized educational systems.We release the dataset and code to support further research at the intersection of content understanding, learner modeling, and adaptive assessment: github.com/

Openalex Percentile: Top 90%
Intelligent Tutoring Systems and Adaptive Learning
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.