Limits of ChatGPT's conversational pragmatics in a Turing test on ethics, commonsense, and cultural sensitivity

Does ChatGPT deliver its explicit claim to be culturally sensitive and its implicit claim to be a friendly digital person when conversing with human users? These claims are investigated from the perspective of linguistic pragmatics, particularly Grice's cooperative principle in communication. Following the pattern of real-life communication, turn-taking conversations reveal limitations in the LLM's grasp of the entire contextual setting described in the prompt. The prompts included ethical issues, a hiking adventure, geographical orientation and body movement. For cultural sensitivity the prompts came from a Pakistani Muslim in English language, from a Hindu in English, and from a Chinese in Chinese language. The issues were deeply cultural involving feelings and emotions. Qualitative analysis of the conversation pragmatics showed that ChatGPT is often unable to conduct conversations according to the pragmatic principles of quantity, reliable quality, remaining in focus, and being clear in expression. We conclude that ChatGPT should be promoted as a machine and not a faux human and not be presented as a global LLM but be subdivided into culture-specific modules.

Authors

Institutions

Publication Details

Journal
Computers in Human Behavior Artificial Humans
Published
2025-08-01
DOI
https://doi.org/10.1016/j.chbah.2025.100191
Primary Topic
Psychology of Moral and Emotional Judgment
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Limits of ChatGPT's conversational pragmatics in a Turing test on ethics, commonsense, and cultural sensitivity

Athena Vakali, Maria Michali, George Gaskell, Wolfgang Wagner et al.
Computers in Human Behavior Artificial Humans
Psychology of Moral and Emotional Judgment
article

Limits of ChatGPT's conversational pragmatics in a Turing test on ethics, commonsense, and cultural sensitivity

Athena Vakali, Maria Michali, George Gaskell, Wolfgang Wagner, Siqi Lyu, Eva Paraschou
article en

Abstract

Does ChatGPT deliver its explicit claim to be culturally sensitive and its implicit claim to be a friendly digital person when conversing with human users? These claims are investigated from the perspective of linguistic pragmatics, particularly Grice's cooperative principle in communication. Following the pattern of real-life communication, turn-taking conversations reveal limitations in the LLM's grasp of the entire contextual setting described in the prompt. The prompts included ethical issues, a hiking adventure, geographical orientation and body movement. For cultural sensitivity the prompts came from a Pakistani Muslim in English language, from a Hindu in English, and from a Chinese in Chinese language. The issues were deeply cultural involving feelings and emotions. Qualitative analysis of the conversation pragmatics showed that ChatGPT is often unable to conduct conversations according to the pragmatic principles of quantity, reliable quality, remaining in focus, and being clear in expression. We conclude that ChatGPT should be promoted as a machine and not a faux human and not be presented as a global LLM but be subdivided into culture-specific modules.

Computers in Human Behavior Artificial HumansVol. 5
Aristotle University of Thessaloniki (GR), University of Tartu (EE), London School of Economics and Political Science (GB)
Reduced inequalities
Openalex Percentile: Top 81%
Psychology of Moral and Emotional Judgment
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Limits of ChatGPT's conversational pragmatics in a Turing test on ethics, commonsense, and cultural sensitivity — Athena Vakali, Maria Michali, et al. · Computers in Human Behavior Artificial Humans (2025) | TGRS Research Map | TGRS