Exploring Religions and Cross-Cultural Sensitivities in Conversational AI

With the fast growth of conversational AI, it is very important that these systems can handle religion and cultural sensitivity correctly. New, cutting-edge models like BERT, mBERT (multilingual BERT), and XLM-RoBERTa are very good at many types of natural language processing. But not a lot is known about how well they talk and act about their religious views. The dataset primarily contains content related to Christianity, Islam, and Hinduism, reflecting their prevalence in online discussions and AI training corpora. AIs need to learn how to deal with harsh words, social nuances, and touchy topics where they can talk about religion. Artificial intelligence systems could give answers that don't seem to be legit or different meaning which are very sensitive. This is a big ethical problem.We look at how well BERT, mBERT, and XLM-RoBERTa can handle religious and cultural situations in this study. We focus on how well they do across languages using the PAWS-X dataset. PAWS-X is a good tool for testing cross-lingual transfer because it has goals for finding paraphrases in a number of different languages. This lets us see how well these models understand complex meanings in a variety of linguistic and cultural settings. We use the dataset to test how well the model works in talks about Hinduism, Islam, and Christianity, which are very sensitive to cultural and religious differences.To see how well these models can understand underlying cultural differences and come up with suitable responses, we test them on religious sentence pairs as part of our methodology. We test both their language skills and their ability to stay sensitive when religious or doctrinal information is present. We also look into their cross-lingual transfer skills to see how well they work in different religious meaning. BERT, mBERT, and XLM-RoBERTa perform well in basic tasks but struggle with religious and cultural nuances. BERT and mBERT handle multiple languages effectively but often falter in unclear religious contexts, especially when switching between languages with unique religious terms.In this study, we assess sensitivity by analyzing model responses for their ability to correctly interpret religious connotations, avoid offensive language, and acknowledge cultural context. We apply sentiment analysis, contextual relevance scoring, and manual validation from domain experts to measure how well these models handle sensitive topics.

Authors

Institutions

Publication Details

Published
2025-02-06
DOI
https://doi.org/10.1109/aide64228.2025.10987489
Primary Topic
AI in Service Interactions
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Exploring Religions and Cross-Cultural Sensitivities in Conversational AI

Faisal Rahman, Rahul Debnath, Rabeya Nazara, Md Jahid Alam Riad et al.
AI in Service Interactions
article

Exploring Religions and Cross-Cultural Sensitivities in Conversational AI

Faisal Rahman, Rahul Debnath, Rabeya Nazara, Md Jahid Alam Riad, Mahfuzur Rahman Shuvo, Prosenjit Roy, Nobanul Hasan
article en

Abstract

With the fast growth of conversational AI, it is very important that these systems can handle religion and cultural sensitivity correctly. New, cutting-edge models like BERT, mBERT (multilingual BERT), and XLM-RoBERTa are very good at many types of natural language processing. But not a lot is known about how well they talk and act about their religious views. The dataset primarily contains content related to Christianity, Islam, and Hinduism, reflecting their prevalence in online discussions and AI training corpora. AIs need to learn how to deal with harsh words, social nuances, and touchy topics where they can talk about religion. Artificial intelligence systems could give answers that don't seem to be legit or different meaning which are very sensitive. This is a big ethical problem.We look at how well BERT, mBERT, and XLM-RoBERTa can handle religious and cultural situations in this study. We focus on how well they do across languages using the PAWS-X dataset. PAWS-X is a good tool for testing cross-lingual transfer because it has goals for finding paraphrases in a number of different languages. This lets us see how well these models understand complex meanings in a variety of linguistic and cultural settings. We use the dataset to test how well the model works in talks about Hinduism, Islam, and Christianity, which are very sensitive to cultural and religious differences.To see how well these models can understand underlying cultural differences and come up with suitable responses, we test them on religious sentence pairs as part of our methodology. We test both their language skills and their ability to stay sensitive when religious or doctrinal information is present. We also look into their cross-lingual transfer skills to see how well they work in different religious meaning. BERT, mBERT, and XLM-RoBERTa perform well in basic tasks but struggle with religious and cultural nuances. BERT and mBERT handle multiple languages effectively but often falter in unclear religious contexts, especially when switching between languages with unique religious terms.In this study, we assess sensitivity by analyzing model responses for their ability to correctly interpret religious connotations, avoid offensive language, and acknowledge cultural context. We apply sentiment analysis, contextual relevance scoring, and manual validation from domain experts to measure how well these models handle sensitive topics.

American University (US), Prairie View A&M University (US)
Openalex Percentile: Top 95%
AI in Service Interactions
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.