An Adapted Few-Shot Prompting Technique Using ChatGPT to Advance Low-Resource Languages Understanding

The lack of annotated data in low-resource languages presents a significant challenge in natural language processing, particularly for language understanding tasks such as intent detection and slot filling. To address this, we propose a novel approach that first employs an effective cross-lingual transfer model to generate labeled data for the target language, overcoming the scarcity of labeled data in low-resource settings. The main contribution of our work lies in the second step, where we introduce an adapted few-shot prompting technique to guide ChatGPT as a large language model (LLM). In this step, a subset of the machine-generated examples is selected based on the domain of the input, ensuring that the LLM is provided with more tailored and domain-specific examples. This two-step process leads to enhanced performance in handling low-resource languages. We conduct extensive experiments on Spanish, Thai, and Persian using the Facebook-multilingual and Persian-ATIS datasets. Experimental results demonstrate that our method outperforms existing techniques for non-Latin languages, such as Thai and Persian, and matches state-of-the-art performance for Latin-based languages, such as Spanish. The repository for this study is publicly available at https://github.com/saedeht/language-understanding-chatgpt.

Authors

Institutions

Publication Details

Journal
IEEE Access
Published
2025-01-01
DOI
https://doi.org/10.1109/access.2025.3574115
Citations
1
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
2.48
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

An Adapted Few-Shot Prompting Technique Using ChatGPT to Advance Low-Resource Languages Understanding

Saeed Farzi, Saedeh Tahery
1 citations
IEEE Access
Topic Modeling
2.48
article

An Adapted Few-Shot Prompting Technique Using ChatGPT to Advance Low-Resource Languages Understanding

Saeed Farzi, Saedeh Tahery
article en
1 citations

Abstract

The lack of annotated data in low-resource languages presents a significant challenge in natural language processing, particularly for language understanding tasks such as intent detection and slot filling. To address this, we propose a novel approach that first employs an effective cross-lingual transfer model to generate labeled data for the target language, overcoming the scarcity of labeled data in low-resource settings. The main contribution of our work lies in the second step, where we introduce an adapted few-shot prompting technique to guide ChatGPT as a large language model (LLM). In this step, a subset of the machine-generated examples is selected based on the domain of the input, ensuring that the LLM is provided with more tailored and domain-specific examples. This two-step process leads to enhanced performance in handling low-resource languages. We conduct extensive experiments on Spanish, Thai, and Persian using the Facebook-multilingual and Persian-ATIS datasets. Experimental results demonstrate that our method outperforms existing techniques for non-Latin languages, such as Thai and Persian, and matches state-of-the-art performance for Latin-based languages, such as Spanish. The repository for this study is publicly available at https://github.com/saedeht/language-understanding-chatgpt.

IEEE AccessVol. 13
K. N. Toosi University of Technology (IR)
Openalex Percentile: Top 10%
Topic Modeling
2.48
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.