Model Explanations for Gender and Ethnicity Bias Mitigation in AI-Generated Narratives

Large Language Models (LLMs) are increasingly utilized in diverse applications, ranging from professional content creation to decision-making systems. However, their outputs often amplify the biases present in their training data, perpetuating stereotypes and reinforcing societal inequities, particularly regarding gender and ethnicity. Such biases can cause tangible harm, especially for underrepresented groups, and require awareness and effective mitigation strategies. This work explores gender and ethnicity representation in narratives created by generative AI describing 25 occupational fields defined by the U.S. Bureau of Labor Statistics. We examine three large language models (LLMs)--Llama 3.1 70B Instruct, Claude 3.5 Sonnet, and GPT 4.0 Turbo. Employing a novel approach that leverages model-generated explanations, we assess bias before and after mitigation using two metrics: Demographic Parity Ratio (DPR) and Total Variation Distance (TVD). Our findings reveal that incorporating model explanations significantly improves demographic representation, reducing biases by 2%-20% across different models and occupations. Qualitative analysis of the generated stories indicates high levels of creativity, coherence, and inclusivity, demonstrating the potential of targeted interventions to produce equitable narratives. This research contributes a robust dataset of occupational narratives and a systematic framework for bias mitigation, advancing the understanding of LLM behavior and promoting ethical AI development. By aligning explainability with equity, this work underscores the critical role of transparency and accountability in the deployment of generative AI systems.

Publication Details

Journal
PDXScholar (Portland State University)
Published
2025-03-04
Primary Topic
Artificial Intelligence in Healthcare and Education
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Model Explanations for Gender and Ethnicity Bias Mitigation in AI-Generated Narratives

PDXScholar (Portland State University)
Artificial Intelligence in Healthcare and Education
article

Model Explanations for Gender and Ethnicity Bias Mitigation in AI-Generated Narratives

article en

Abstract

Large Language Models (LLMs) are increasingly utilized in diverse applications, ranging from professional content creation to decision-making systems. However, their outputs often amplify the biases present in their training data, perpetuating stereotypes and reinforcing societal inequities, particularly regarding gender and ethnicity. Such biases can cause tangible harm, especially for underrepresented groups, and require awareness and effective mitigation strategies. This work explores gender and ethnicity representation in narratives created by generative AI describing 25 occupational fields defined by the U.S. Bureau of Labor Statistics. We examine three large language models (LLMs)--Llama 3.1 70B Instruct, Claude 3.5 Sonnet, and GPT 4.0 Turbo. Employing a novel approach that leverages model-generated explanations, we assess bias before and after mitigation using two metrics: Demographic Parity Ratio (DPR) and Total Variation Distance (TVD). Our findings reveal that incorporating model explanations significantly improves demographic representation, reducing biases by 2%-20% across different models and occupations. Qualitative analysis of the generated stories indicates high levels of creativity, coherence, and inclusivity, demonstrating the potential of targeted interventions to produce equitable narratives. This research contributes a robust dataset of occupational narratives and a systematic framework for bias mitigation, advancing the understanding of LLM behavior and promoting ethical AI development. By aligning explainability with equity, this work underscores the critical role of transparency and accountability in the deployment of generative AI systems.

PDXScholar (Portland State University)
Gender equality
Openalex Percentile: Top 53%
Artificial Intelligence in Healthcare and Education
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.