Towards Debiasing Code Review Support

Background: Current state-of-the-art established that cognitive biases appear during code review. They significantly impact the creation of feedback and how developers interpret it. These biases can lead to illogical reasoning and decision-making, violating one of the main hypotheses supporting code review: developers' accurate and objective code evaluation. Objective: This paper explores harmful cases caused by cognitive biases during code review and potential solutions to avoid such cases or mitigate their effects. Method: We design several prototypes covering confirmation bias and decision fatigue. We rely on a developer-centered design approach by conducting usability tests and validating the prototype with a user experience questionnaire (UEQ) and participants' feedback. Results: Our interim findings show that some techniques could be implemented in existing code review tools as reviewers will accept them and help prevent behavior detrimental to code review. Conclusion: This work provides a first approach to treating cognitive bias in code review. The developed prototypes will evolve into fully functional tools, with an extensive evaluation with developers.

Authors

Institutions

Publication Details

Published
2025-04-27
DOI
https://doi.org/10.1109/chase66643.2025.00025
Primary Topic
Advanced Software Engineering Methodologies
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Towards Debiasing Code Review Support

Benoît Vanderose, Xavier Devroey, Tobias Jetzen, Nicolas Matton
Advanced Software Engineering Methodologies
article

Towards Debiasing Code Review Support

Benoît Vanderose, Xavier Devroey, Tobias Jetzen, Nicolas Matton
article en

Abstract

Background: Current state-of-the-art established that cognitive biases appear during code review. They significantly impact the creation of feedback and how developers interpret it. These biases can lead to illogical reasoning and decision-making, violating one of the main hypotheses supporting code review: developers' accurate and objective code evaluation. Objective: This paper explores harmful cases caused by cognitive biases during code review and potential solutions to avoid such cases or mitigate their effects. Method: We design several prototypes covering confirmation bias and decision fatigue. We rely on a developer-centered design approach by conducting usability tests and validating the prototype with a user experience questionnaire (UEQ) and participants' feedback. Results: Our interim findings show that some techniques could be implemented in existing code review tools as reviewers will accept them and help prevent behavior detrimental to code review. Conclusion: This work provides a first approach to treating cognitive bias in code review. The developed prototypes will evolve into fully functional tools, with an extensive evaluation with developers.

University of Namur (BE)
Openalex Percentile: Top 94%
Advanced Software Engineering Methodologies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.