Applying Prompt-Based Mitigation of Gender-Role Bias in Large Language Models for Security

As large language models (LLMs) become increasingly integrated into society, concerns over fairness and bias have emerged as critical areas of research. Prior research has demonstrated that LLMs often reflect stereotypes present in their training data, and while this is informative, systematic studies producing rigorous experiments and tangible measurements re-main limited. Furthermore, as LLMs are deployed in security-sensitive domains, such as industrial control systems (ICS), Internet-of- Things (loT) networks, and critical infrastructure, ex-ploring tangible, quantitative bias mitigation techniques becomes essential for real-time deployment. In this work, as a proof of concept, we apply our pipelines to 53 gender-neutral professional resume prompts to generally analyze how LLMs assign gender-specific attributes. Using these prompts, we implement four distinct mitigation pipelines: a Baseline with no intervention, In-Context Example prompting, Self-Evaluation and Regeneration, and Chain-of- Thought (CoT) reasoning. Furthermore, to quantify each pipeline, we introduce the Stereotype Alignment Rate (SAR) to quantify bias, defined as the percentage of outputs conforming to traditional gender stereotypes. Results across each experimental pipeline indicate an effective reduction in bias, lowering the SAR by up to 15% compared to the baseline. This work demonstrates that prompt engineering, particularly through the use of counter-stereotypical examples, can serve as an effective and lightweight method for mitigating bias in LLM outputs.

Authors

Institutions

Publication Details

Published
2025-09-08
DOI
https://doi.org/10.1109/cns66487.2025.11194978
Primary Topic
Hate Speech and Cyberbullying Detection
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Applying Prompt-Based Mitigation of Gender-Role Bias in Large Language Models for Security

Shari Watkins, Lanier Watkins, Matthew Dees, K. Stein et al.
Hate Speech and Cyberbullying Detection
article

Applying Prompt-Based Mitigation of Gender-Role Bias in Large Language Models for Security

Shari Watkins, Lanier Watkins, Matthew Dees, K. Stein, Brandon Blackwell, Ernest Funue
article en

Abstract

As large language models (LLMs) become increasingly integrated into society, concerns over fairness and bias have emerged as critical areas of research. Prior research has demonstrated that LLMs often reflect stereotypes present in their training data, and while this is informative, systematic studies producing rigorous experiments and tangible measurements re-main limited. Furthermore, as LLMs are deployed in security-sensitive domains, such as industrial control systems (ICS), Internet-of- Things (loT) networks, and critical infrastructure, ex-ploring tangible, quantitative bias mitigation techniques becomes essential for real-time deployment. In this work, as a proof of concept, we apply our pipelines to 53 gender-neutral professional resume prompts to generally analyze how LLMs assign gender-specific attributes. Using these prompts, we implement four distinct mitigation pipelines: a Baseline with no intervention, In-Context Example prompting, Self-Evaluation and Regeneration, and Chain-of- Thought (CoT) reasoning. Furthermore, to quantify each pipeline, we introduce the Stereotype Alignment Rate (SAR) to quantify bias, defined as the percentage of outputs conforming to traditional gender stereotypes. Results across each experimental pipeline indicate an effective reduction in bias, lowering the SAR by up to 15% compared to the baseline. This work demonstrates that prompt engineering, particularly through the use of counter-stereotypical examples, can serve as an effective and lightweight method for mitigating bias in LLM outputs.

Johns Hopkins University (US), American University (US)
Openalex Percentile: Top 85%
Hate Speech and Cyberbullying Detection
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Applying Prompt-Based Mitigation of Gender-Role Bias in Large Language Models for Security — Shari Watkins, Lanier Watkins, et al. · (2025) | TGRS Research Map | TGRS