Finer partitions, weaker evidence: marginal fairness hides intersectional harm across five Sub-Saharan African Low-and-middle-income Countries

Abstract Background Fairness audits in artificial intelligence (AI) still test one protected attribute at a time. We prove by construction that single-axis parity does not bound intersectional parity, then test this gap empirically on stunting-risk models built on child health data from five low-and-middle-income African countries. A second question follows directly: can that evidence be trusted once the obvious fix, a finer partition, strains a limited sample? Results Auditing more finely does not automatically buy more trustworthy evidence. We apply the counterfactual false positive/false negative rate framework of Wastvedt, Huling and Wolfson (2024) to stunting-risk models on Demographic and Health Survey data from Nigeria (2024; n = 5,747; 30 cells), Ghana (2022; n = 2,833; 73 cells), DR Congo (2023-24; n = 6,678; 112 cells), Liberia (2019-20; n = 1,568; 23 cells), and Ethiopia (2024-25; n = 3,481; 63 cells). In every country, the intersectional maximum pairwise gap (Δ_MAX) exceeds both single-axis Δ_MAX values, on both cFPR and cFNR: Nigeria (0.584, 0.849), Ghana (0.918, 1.000), DR Congo (0.658, 0.906), Liberia (0.398, 0.635), Ethiopia (1.000, 1.000). A permutation u-value test (R = 500, δ = 0.1) tells a sharper story: strong evidence for this excess appears only where the partition is coarse relative to the primary-sampling-unit (PSU) count (Nigeria, u = 0.836–0.866), while the four finer-partitioned countries return markedly weaker evidence for the same, often larger, gap: a partition-granularity effect in which a finer partition on a smaller sample inflates both the gap and its null. Conclusions An intersectional audit is not automatically more trustworthy than a marginal one simply because it is finer. Across five low-and-middle-income country (LMIC) settings, statistical confidence in an intersectional gap tracks partition granularity relative to sample size and PSU count, not gap size alone. Theory and measurement also agree without exception on the prior claim: a fairness audit stopping at single protected attributes understates the disparity a model carries at the intersections. For the Sustainable Development Goal (SDG) 10 of the United Nations, neither finding is a footnote; together they separate a model certified fair from a model that is fair.

Authors

Institutions

Publication Details

Journal
Research Square
Published
2026-11-04
DOI
https://doi.org/10.21203/rs.3.rs-11138285/v1
Primary Topic
Ethics and Social Impacts of AI
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

Finer partitions, weaker evidence: marginal fairness hides intersectional harm across five Sub-Saharan African Low-and-middle-income Countries

Oluropo Babafemi Macaulay, Alaba Bolaji OJEDIRAN, Bolanle Omowumi Ojediran
Research Square
Ethics and Social Impacts of AI
preprint

Finer partitions, weaker evidence: marginal fairness hides intersectional harm across five Sub-Saharan African Low-and-middle-income Countries

Oluropo Babafemi Macaulay, Alaba Bolaji OJEDIRAN, Bolanle Omowumi Ojediran
preprint en

Abstract

Abstract Background Fairness audits in artificial intelligence (AI) still test one protected attribute at a time. We prove by construction that single-axis parity does not bound intersectional parity, then test this gap empirically on stunting-risk models built on child health data from five low-and-middle-income African countries. A second question follows directly: can that evidence be trusted once the obvious fix, a finer partition, strains a limited sample? Results Auditing more finely does not automatically buy more trustworthy evidence. We apply the counterfactual false positive/false negative rate framework of Wastvedt, Huling and Wolfson (2024) to stunting-risk models on Demographic and Health Survey data from Nigeria (2024; n = 5,747; 30 cells), Ghana (2022; n = 2,833; 73 cells), DR Congo (2023-24; n = 6,678; 112 cells), Liberia (2019-20; n = 1,568; 23 cells), and Ethiopia (2024-25; n = 3,481; 63 cells). In every country, the intersectional maximum pairwise gap (Δ_MAX) exceeds both single-axis Δ_MAX values, on both cFPR and cFNR: Nigeria (0.584, 0.849), Ghana (0.918, 1.000), DR Congo (0.658, 0.906), Liberia (0.398, 0.635), Ethiopia (1.000, 1.000). A permutation u-value test (R = 500, δ = 0.1) tells a sharper story: strong evidence for this excess appears only where the partition is coarse relative to the primary-sampling-unit (PSU) count (Nigeria, u = 0.836–0.866), while the four finer-partitioned countries return markedly weaker evidence for the same, often larger, gap: a partition-granularity effect in which a finer partition on a smaller sample inflates both the gap and its null. Conclusions An intersectional audit is not automatically more trustworthy than a marginal one simply because it is finer. Across five low-and-middle-income country (LMIC) settings, statistical confidence in an intersectional gap tracks partition granularity relative to sample size and PSU count, not gap size alone. Theory and measurement also agree without exception on the prior claim: a fairness audit stopping at single protected attributes understates the disparity a model carries at the intersections. For the Sustainable Development Goal (SDG) 10 of the United Nations, neither finding is a footnote; together they separate a model certified fair from a model that is fair.

Research Square
Lagos State Government (NG)
Ethics and Social Impacts of AI
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon