Enhancing Accuracy in Peer Assessment by Addressing Bias and Outliers Through Calibration Method

Peer assessment is increasingly used in educational settings as a tool to enhance learning quality and critical thinking. However, this process comes with challenges, such as ensuring the fairness and accuracy of evaluations. In this article, we explore methods for analyzing and correcting student grades within peer assessment systems. Special emphasis is placed on identifying and quantifying biastendencies of individual students to systematically assign higher or lower grades-and on detecting and managing outliers-grades that significantly deviate from the average. We also examine the calibration method, in which students evaluate tests graded by instructors, allowing for the assessment of individual evaluator accuracy. By combining these methods, the accuracy and reliability of peer assessment can be improved, and the results of this research provide guidelines for designing more effective assessment systems.

Authors

Institutions

Publication Details

Published
2025-06-02
DOI
https://doi.org/10.1109/mipro65660.2025.11131879
Primary Topic
Student Assessment and Feedback
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Enhancing Accuracy in Peer Assessment by Addressing Bias and Outliers Through Calibration Method

Melita Fertalj, Igor Mekterović, Lj. Brkić
Student Assessment and Feedback
article

Enhancing Accuracy in Peer Assessment by Addressing Bias and Outliers Through Calibration Method

Melita Fertalj, Igor Mekterović, Lj. Brkić
article en

Abstract

Peer assessment is increasingly used in educational settings as a tool to enhance learning quality and critical thinking. However, this process comes with challenges, such as ensuring the fairness and accuracy of evaluations. In this article, we explore methods for analyzing and correcting student grades within peer assessment systems. Special emphasis is placed on identifying and quantifying biastendencies of individual students to systematically assign higher or lower grades-and on detecting and managing outliers-grades that significantly deviate from the average. We also examine the calibration method, in which students evaluate tests graded by instructors, allowing for the assessment of individual evaluator accuracy. By combining these methods, the accuracy and reliability of peer assessment can be improved, and the results of this research provide guidelines for designing more effective assessment systems.

University of Zagreb (HR)
Openalex Percentile: Top 74%
Student Assessment and Feedback
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.