Comparing generative AI with native speakers in terms of request expressions in Japanese

Generative artificial intelligence (GenAI) tools are increasingly integrated into language education, yet their capacity to model nuanced pragmatic competence remains a critical area of investigation. This study compares the realization of Japanese request expressions by three contemporary GenAI models with those produced by 30 native Japanese speakers. Utilizing a Discourse Completion Test, responses were analyzed for formal complexity, level of directness, and the diversity of request head acts. The findings reveal significant divergences between AI-generated and native speaker outputs. Regarding formal complexity, AI models, particularly Gemini 2.0, tend to overuse address terms and display distinct patterns when employing politeness modifications. Significant differences were observed in the selection of directness strategies. While capable of generating a wide array of request forms, AI responses often lack natural spoken language features common in native Japanese, such as dialectal variations and omissions, instead adhering to a more formal, standardized register. These results suggest that current GenAI tools do not consistently replicate native speaker pragmatic norms for Japanese requests, highlighting the need for caution among learners and educators. The study underscores the ongoing gap between AI’s formal linguistic generation and its functional pragmatic competence, emphasizing the importance of critical engagement with these technologies in language learning contexts.

Authors

Institutions

Publication Details

Journal
Discover Education
Published
2025-11-10
DOI
https://doi.org/10.1007/s44217-025-00920-w
Primary Topic
Neurobiology of Language and Bilingualism
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Comparing generative AI with native speakers in terms of request expressions in Japanese

Yijun Chen, Yue Peng, Henry Davidge
Discover Education
Neurobiology of Language and Bilingualism
article

Comparing generative AI with native speakers in terms of request expressions in Japanese

Yijun Chen, Yue Peng, Henry Davidge
article en

Abstract

Generative artificial intelligence (GenAI) tools are increasingly integrated into language education, yet their capacity to model nuanced pragmatic competence remains a critical area of investigation. This study compares the realization of Japanese request expressions by three contemporary GenAI models with those produced by 30 native Japanese speakers. Utilizing a Discourse Completion Test, responses were analyzed for formal complexity, level of directness, and the diversity of request head acts. The findings reveal significant divergences between AI-generated and native speaker outputs. Regarding formal complexity, AI models, particularly Gemini 2.0, tend to overuse address terms and display distinct patterns when employing politeness modifications. Significant differences were observed in the selection of directness strategies. While capable of generating a wide array of request forms, AI responses often lack natural spoken language features common in native Japanese, such as dialectal variations and omissions, instead adhering to a more formal, standardized register. These results suggest that current GenAI tools do not consistently replicate native speaker pragmatic norms for Japanese requests, highlighting the need for caution among learners and educators. The study underscores the ongoing gap between AI’s formal linguistic generation and its functional pragmatic competence, emphasizing the importance of critical engagement with these technologies in language learning contexts.

Discover EducationVol. 4(1)
Institute of Sugar Beet (CN), Kyoto Seizan College (JP), Shizuoka Eiwa Gakuin University (JP)
Openalex Percentile: Top 66%
Neurobiology of Language and Bilingualism
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Comparing generative AI with native speakers in terms of request expressions in Japanese — Yijun Chen, Yue Peng, et al. · Discover Education (2025) | TGRS Research Map | TGRS