Soft Grades: A Calibrated and Accurate Method for Course-Grade Estimation that Expresses Uncertainty

In traditional educational settings, students are often summarized by a single number-a final course grade-that reflects their performance.While final grades are convenient for reporting or comparison, they oversimplify a student's true ability and do not express uncertainty.In this paper, we introduce a new item-response model for classroom settings that infers a distribution over student abilities and uses this to represent each student's final grade as a probability distribution.This approach captures the uncertainty that comes from variations in both student performance and grading processes.Practical applications of our approach include enabling teachers to better understand grading confidence, impute missing assignment scores, and make informed decisions when curving final grades.For students, the model offers probabilistic estimates of their final course grades based on current performance, supporting informed academic decisions such as opting for Pass/Fail grading.We evaluate our model using real-world datasets, showing that the Soft Grades model is well-calibrated and surpasses the state-of-the-art polytomous IRT model in accurately predicting future scores.Additionally, we share a web application and Python scripts to make our model available to teachers and students. CCS Concepts Computing methodologies Model verification and validation; Model development and analysis.

Authors

Institutions

Publication Details

Published
2025-02-21
DOI
https://doi.org/10.1145/3706468.3706568
Primary Topic
Intelligent Tutoring Systems and Adaptive Learning
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Soft Grades: A Calibrated and Accurate Method for Course-Grade Estimation that Expresses Uncertainty

Juliette Woodrow, Chris Piech
Intelligent Tutoring Systems and Adaptive Learning
article

Soft Grades: A Calibrated and Accurate Method for Course-Grade Estimation that Expresses Uncertainty

Juliette Woodrow, Chris Piech
article en

Abstract

In traditional educational settings, students are often summarized by a single number-a final course grade-that reflects their performance.While final grades are convenient for reporting or comparison, they oversimplify a student's true ability and do not express uncertainty.In this paper, we introduce a new item-response model for classroom settings that infers a distribution over student abilities and uses this to represent each student's final grade as a probability distribution.This approach captures the uncertainty that comes from variations in both student performance and grading processes.Practical applications of our approach include enabling teachers to better understand grading confidence, impute missing assignment scores, and make informed decisions when curving final grades.For students, the model offers probabilistic estimates of their final course grades based on current performance, supporting informed academic decisions such as opting for Pass/Fail grading.We evaluate our model using real-world datasets, showing that the Soft Grades model is well-calibrated and surpasses the state-of-the-art polytomous IRT model in accurately predicting future scores.Additionally, we share a web application and Python scripts to make our model available to teachers and students. CCS Concepts Computing methodologies Model verification and validation; Model development and analysis.

Stanford University (US)
Quality Education
Openalex Percentile: Top 99%
Intelligent Tutoring Systems and Adaptive Learning
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.