Stable Diffusion Exposed: Gender Bias from Prompt to Image

Several studies have raised awareness about social biases in image generative models, demonstrating their predisposition towards stereotypes and imbalances. This paper contributes to this growing body of research by introducing an evaluation protocol that analyzes the impact of gender indicators at every step of the generation process on Stable Diffusion images. Leveraging insights from prior work, we explore how gender indicators not only affect gender presentation but also the representation of objects and layouts within the generated images. Our findings include the existence of differences in the depiction of objects, such as instruments tailored for specific genders, and shifts in overall layouts. We also reveal that neutral prompts tend to produce images more aligned with masculine prompts than their feminine counterparts. We further explore where bias originates through representational disparities and how it manifests in the images via prompt-image dependencies, and provide recommendations for developers and users to mitigate potential bias in image generation.

Authors

Institutions

Publication Details

Journal
Proceedings of the AAAI/ACM Conference on AI Ethics and Society
Published
2024-10-16
DOI
https://doi.org/10.1609/aies.v7i1.31754
Citations
3
Primary Topic
Radiative Heat Transfer Studies
Type
article
Field-Weighted Citation Impact
1.12

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Stable Diffusion Exposed: Gender Bias from Prompt to Image

Yankun Wu, Noa García, Yuta Nakashima
3 citations
Proceedings of the AAAI/ACM Conference on AI Ethics and Society
Radiative Heat Transfer Studies
1.12
article

Stable Diffusion Exposed: Gender Bias from Prompt to Image

Yankun Wu, Noa García, Yuta Nakashima
article en
3 citations

Abstract

Several studies have raised awareness about social biases in image generative models, demonstrating their predisposition towards stereotypes and imbalances. This paper contributes to this growing body of research by introducing an evaluation protocol that analyzes the impact of gender indicators at every step of the generation process on Stable Diffusion images. Leveraging insights from prior work, we explore how gender indicators not only affect gender presentation but also the representation of objects and layouts within the generated images. Our findings include the existence of differences in the depiction of objects, such as instruments tailored for specific genders, and shifts in overall layouts. We also reveal that neutral prompts tend to produce images more aligned with masculine prompts than their feminine counterparts. We further explore where bias originates through representational disparities and how it manifests in the images via prompt-image dependencies, and provide recommendations for developers and users to mitigate potential bias in image generation.

Proceedings of the AAAI/ACM Conference on AI Ethics and SocietyVol. 7
The University of Osaka (JP)
Japan Society for the Promotion of Science, Core Research for Evolutional Science and Technology
Openalex Percentile: Top 24%
Radiative Heat Transfer Studies
1.12
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.