Strategic Best-Response Fairness Framework for Fair Machine Learning
This study introduces a framework called “strategic best-response fairness” (SBR-fairness) to address discrimination perpetuated by machine-learning (ML) algorithms. It challenges the conventional focus on fairness solely in prediction results, arguing that this approach ignores how individuals affected by the predictions may alter their behavior in response to algorithmic decisions. The framework considers whether an algorithm, trained on potentially biased data, leads to identical equilibrium behaviors across different subpopulations that are ex ante identical. The study finds that common fair-ML algorithms, such as those relying on color-blindness and demographic parity fairness criteria, do not always achieve SBR fairness. This means that they may not eliminate disparities in effort and outcomes. Equalized odds (EO), however, have been shown to achieve SBR fairness, but they suffer from several practical limitations. The study proposes that SBR fairness is a necessary condition for breaking cycles of discrimination in ML. It also argues that SBR fairness offers a complementary way to assess other fairness criteria and understand behavioral responses. The findings suggest a need for policy and practical focus on designing SBR-fair algorithms that promote equitable outcomes at both the prediction and behavioral level.
Authors
- Karthik Kannan (ORCID: https://orcid.org/0000-0002-9861-0717)
- Maxime C. Cohen (ORCID: https://orcid.org/0000-0002-2474-3875)
- Warut Khern-am-nuai (ORCID: https://orcid.org/0000-0002-1028-1593)
- Hajime Shimao (ORCID: https://orcid.org/0000-0003-0951-7930)
Institutions
- Pennsylvania State University (US)
- University of Arizona (US)
- McGill University (CA)
Publication Details
- Journal
- Information Systems Research
- Published
- 2025-04-07
- DOI
- https://doi.org/10.1287/isre.2022.0055
- Citations
- 2
- Primary Topic
- Ethics and Social Impacts of AI
- Type
- article
- Field-Weighted Citation Impact
- 4.73