A Framework for Measuring and Benchmarking Fairness of Generative Crowd-Flow Models

Urban population growth has significantly complicated the management of mobility systems, demanding innovative tools for planning. Generative Crowd-Flow (GCF) models, which leverage machine learning to simulate urban movement patterns, offer a promising solution but lack sufficient evaluation of their fairness–a critical factor for equitable urban planning. We present an approach to measure and benchmark the fairness of GCF models by developing a first-of-its-kind set of fairness metrics specifically tailored for this purpose. Using observed flow data, we employ a stochastic biased sampling approach to generate multiple permutations of Origin-Destination datasets, each demonstrating intentional bias. Our proposed framework allows for the comparison of multiple GCF models to evaluate how models introduce bias in outputs. Preliminary results indicate a tradeoff between model accuracy and fairness, underscoring the need for careful consideration in the deployment of these technologies. To this end, this study bridges the gap between human mobility literature and fairness in machine learning, with potential to help urban planners and policymakers leverage GCF models for more equitable urban infrastructure development.