Stable Diffusion Exposed: Gender Bias from Prompt to Image
Several studies have raised awareness about social biases in image generative models, demonstrating their predisposition towards stereotypes and imbalances. This paper contributes to this growing body of research by introducing an evaluation protocol that analyzes the impact of gender indicators at every step of the generation process on Stable Diffusion images. Leveraging insights from prior work, we explore how gender indicators not only affect gender presentation but also the representation of objects and layouts within the generated images. Our findings include the existence of differences in the depiction of objects, such as instruments tailored for specific genders, and shifts in overall layouts. We also reveal that neutral prompts tend to produce images more aligned with masculine prompts than their feminine counterparts. We further explore where bias originates through representational disparities and how it manifests in the images via prompt-image dependencies, and provide recommendations for developers and users to mitigate potential bias in image generation.
Authors
- Yankun Wu (ORCID: https://orcid.org/0009-0005-7175-8307)
- Noa García (ORCID: https://orcid.org/0000-0002-9200-6359)
- Yuta Nakashima (ORCID: https://orcid.org/0000-0001-8000-3567)
Institutions
- The University of Osaka (JP)
Publication Details
- Journal
- Proceedings of the AAAI/ACM Conference on AI Ethics and Society
- Published
- 2024-10-16
- DOI
- https://doi.org/10.1609/aies.v7i1.31754
- Citations
- 3
- Primary Topic
- Radiative Heat Transfer Studies
- Type
- article
- Field-Weighted Citation Impact
- 1.12
Funders
- Japan Society for the Promotion of Science
- Core Research for Evolutional Science and Technology