An Analysis of Korean Homonym Comprehension in Generative AI: Focusing on Semantic Disambiguation through ChatGPT-4o.

This study aims to experimentally examine the semantic disambiguation ability of the generative AI model ChatGPT-4o with regard to Korean homonyms, thereby exploring its linguistic accuracy and limitations. The target homonyms selected for the study include Bae (Pear vs. Multiple), Nun (Eye vs. Snow), Sijang (Mayor vs. Market), and Jungsik (Lunch vs. Chinese food). From the 2023 National Institute of Korean Language newspaper corpus, a total of 400 context-based example sentences were collected, with an equal number of examples representing each sense of the target words. The experiment was designed with two independent variables: input type (file-based vs. text-based) and data volume (100 vs. 50 sentences). Results showed that text-based inputs yielded relatively higher semantic disambiguation accuracy than file-based inputs, while the amount of data did not significantly affect performance. The study provides the following implications: First, homonyms can serve as effective linguistic tools for evaluating the contextual comprehension ability of generative AI. Second, the input format and data volume can have a practical impact on AI's semantic processing. Third, semantic disambiguation was primarily guided by a rule-based approach, relying on specific keywords rather than deep contextual integration. These findings highlight both the potential and limitations of generative AI in handling languages with high contextual dependency, such as Korean.

Authors

Publication Details

Journal
Korean Semantics
Published
2025-06-30
DOI
https://doi.org/10.19033/sks.2025.6.88.165
Primary Topic
Diverse Approaches in Healthcare and Education Studies
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

An Analysis of Korean Homonym Comprehension in Generative AI: Focusing on Semantic Disambiguation through ChatGPT-4o.

Jung-Jin Shin, Xin Ye, Dan Yi
Korean Semantics
Diverse Approaches in Healthcare and Education Studies
article

An Analysis of Korean Homonym Comprehension in Generative AI: Focusing on Semantic Disambiguation through ChatGPT-4o.

Jung-Jin Shin, Xin Ye, Dan Yi
article en

Abstract

This study aims to experimentally examine the semantic disambiguation ability of the generative AI model ChatGPT-4o with regard to Korean homonyms, thereby exploring its linguistic accuracy and limitations. The target homonyms selected for the study include Bae (Pear vs. Multiple), Nun (Eye vs. Snow), Sijang (Mayor vs. Market), and Jungsik (Lunch vs. Chinese food). From the 2023 National Institute of Korean Language newspaper corpus, a total of 400 context-based example sentences were collected, with an equal number of examples representing each sense of the target words. The experiment was designed with two independent variables: input type (file-based vs. text-based) and data volume (100 vs. 50 sentences). Results showed that text-based inputs yielded relatively higher semantic disambiguation accuracy than file-based inputs, while the amount of data did not significantly affect performance. The study provides the following implications: First, homonyms can serve as effective linguistic tools for evaluating the contextual comprehension ability of generative AI. Second, the input format and data volume can have a practical impact on AI's semantic processing. Third, semantic disambiguation was primarily guided by a rule-based approach, relying on specific keywords rather than deep contextual integration. These findings highlight both the potential and limitations of generative AI in handling languages with high contextual dependency, such as Korean.

Korean SemanticsVol. 88(0)
Reduced inequalities
Openalex Percentile: Top 74%
Diverse Approaches in Healthcare and Education Studies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

An Analysis of Korean Homonym Comprehension in Generative AI: Focusing on Semantic Disambiguation through ChatGPT-4o. — Jung-Jin Shin, Xin Ye, et al. · Korean Semantics (2025) | TGRS Research Map | TGRS