Observing Context Improves Disparity Estimation when Race is Unobserved

In many domains, it is difficult to obtain the race data that is required to estimate racial disparity. To address this problem, practitioners have adopted the use of proxy methods which predict race using non-protected covariates. However, these proxies often yield biased estimates, especially for minority groups, limiting their real-world utility. In this paper, we introduce two new contextual proxy models that advance existing methods by incorporating contextual features in order to improve race estimates. We show that these algorithms demonstrate significant performance improvements in estimating disparities, on real-world home loan and voter data. We establish that achieving unbiased disparity estimates with contextual proxies relies on mean-consistency, a calibration-like condition.

Authors

Institutions

Publication Details

Journal
Proceedings of the AAAI/ACM Conference on AI Ethics and Society
Published
2024-10-16
DOI
https://doi.org/10.1609/aies.v7i1.31680
Primary Topic
Machine Learning and Data Classification
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Observing Context Improves Disparity Estimation when Race is Unobserved

Kweku Kwegyir-Aggrey, Suresh Venkatasubramanian, Jennifer Wang, Naveen Durvasula
1 links
Proceedings of the AAAI/ACM Conference on AI Ethics and Society
Machine Learning and Data Classification
article

Observing Context Improves Disparity Estimation when Race is Unobserved

Kweku Kwegyir-Aggrey, Suresh Venkatasubramanian, Jennifer Wang, Naveen Durvasula
article en

Abstract

In many domains, it is difficult to obtain the race data that is required to estimate racial disparity. To address this problem, practitioners have adopted the use of proxy methods which predict race using non-protected covariates. However, these proxies often yield biased estimates, especially for minority groups, limiting their real-world utility. In this paper, we introduce two new contextual proxy models that advance existing methods by incorporating contextual features in order to improve race estimates. We show that these algorithms demonstrate significant performance improvements in estimating disparities, on real-world home loan and voter data. We establish that achieving unbiased disparity estimates with contextual proxies relies on mean-consistency, a calibration-like condition.

Proceedings of the AAAI/ACM Conference on AI Ethics and SocietyVol. 7
John Brown University (US), Columbia University (US)
Openalex Percentile: Top 81%
Machine Learning and Data Classification
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Observing Context Improves Disparity Estimation when Race is Unobserved — Kweku Kwegyir-Aggrey, Suresh Venkatasubramanian, et al. · Proceedings of the AAAI/ACM Conference on AI Ethics and Society (2024) | TGRS Research Map | TGRS