Using Language Models to Promote Inclusive Language in Software Development Communities

The use of non-inclusive and harmful terminology in software development communities poses significant challenges in fostering an inclusive environment. The HaTe Detector project aims to address this issue by developing a tool that identifies and suggests replacements for harmful terms in computing artifacts.. Non-inclusive language can perpetuate stereotypes, reinforce biases, and create an unwelcoming atmosphere for underrepresented groups. Addressing this issue is important for promoting diversity, equality, and inclusion in tech. The HaTe Detector project uses existing research and tools focused on inclusive language, including the GitHub Inclusifier project, which offer guidelines and automated corrections for promoting inclusive language in technical and everyday contexts. We designed an experiment to evaluate several different LLMS including GPT-4, BERT, RoBERTa, T5, and DistilBERT for their ability to detect and replace harmful terms. We created specific prompts to cover detection, replacement suggestions, contextual understanding, and handling of complex scenarios. Preliminary results indicate that LLMs can effectively identify and suggest replacements for harmful terms and emphasize the potential of LLMs to support automated tools in promoting inclusive language in tech. This project contributes to ongoing efforts to foster a more inclusive tech community by building on existing literature and practicing robust evaluation methods.

Institutions

Publication Details

Journal
George Mason University
Published
2024-10-09
DOI
https://doi.org/10.13021/jssr2024.4228
Primary Topic
Software Engineering Research
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Using Language Models to Promote Inclusive Language in Software Development Communities

George Mason University
Software Engineering Research
article

Using Language Models to Promote Inclusive Language in Software Development Communities

article en

Abstract

The use of non-inclusive and harmful terminology in software development communities poses significant challenges in fostering an inclusive environment. The HaTe Detector project aims to address this issue by developing a tool that identifies and suggests replacements for harmful terms in computing artifacts.. Non-inclusive language can perpetuate stereotypes, reinforce biases, and create an unwelcoming atmosphere for underrepresented groups. Addressing this issue is important for promoting diversity, equality, and inclusion in tech. The HaTe Detector project uses existing research and tools focused on inclusive language, including the GitHub Inclusifier project, which offer guidelines and automated corrections for promoting inclusive language in technical and everyday contexts. We designed an experiment to evaluate several different LLMS including GPT-4, BERT, RoBERTa, T5, and DistilBERT for their ability to detect and replace harmful terms. We created specific prompts to cover detection, replacement suggestions, contextual understanding, and handling of complex scenarios. Preliminary results indicate that LLMs can effectively identify and suggest replacements for harmful terms and emphasize the potential of LLMs to support automated tools in promoting inclusive language in tech. This project contributes to ongoing efforts to foster a more inclusive tech community by building on existing literature and practicing robust evaluation methods.

George Mason University
George Mason University (US)
Reduced inequalities
Openalex Percentile: Top 30%
Software Engineering Research
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.