LLM-Based Localization in the Context of Low-Resource Languages

Recent advancements in large language models (LLMs) have enabled the development of systems capable of generating human-like responses across a wide range of tasks. However, research focus has been primarily on high-resource languages such as English, German, and French, whereas low-resource languages have not benefited from these advances. This has created a challenge for localization which requires multinationals to deploy natural language processing-based tools across world-wide geographic footprints. In this paper, we evaluate the state-of-the-art in question-answering for several low-resource Indian languages, including Hindi and Gujarati, and explore a sample Human Resources use case. We focus on neural machine translation based on transfer learning, multilingual meta-learning, and zero-shot approaches, combined with open source LLMs with conversational capabilities.

Authors

Publication Details

Published
2024-09-30
DOI
https://doi.org/10.1109/aixset62544.2024.00061
Citations
3
Primary Topic
Natural Language Processing Techniques
Type
article
Field-Weighted Citation Impact
1.04
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

LLM-Based Localization in the Context of Low-Resource Languages

Jorjeta G. Jetcheva, Hardi Trivedi, Carlos Rojas
3 citations
Natural Language Processing Techniques
1.04
article

LLM-Based Localization in the Context of Low-Resource Languages

Jorjeta G. Jetcheva, Hardi Trivedi, Carlos Rojas
article en
3 citations

Abstract

Recent advancements in large language models (LLMs) have enabled the development of systems capable of generating human-like responses across a wide range of tasks. However, research focus has been primarily on high-resource languages such as English, German, and French, whereas low-resource languages have not benefited from these advances. This has created a challenge for localization which requires multinationals to deploy natural language processing-based tools across world-wide geographic footprints. In this paper, we evaluate the state-of-the-art in question-answering for several low-resource Indian languages, including Hindi and Gujarati, and explore a sample Human Resources use case. We focus on neural machine translation based on transfer learning, multilingual meta-learning, and zero-shot approaches, combined with open source LLMs with conversational capabilities.

Openalex Percentile: Top 18%
Natural Language Processing Techniques
1.04
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

LLM-Based Localization in the Context of Low-Resource Languages — Jorjeta G. Jetcheva, Hardi Trivedi, et al. · (2024) | TGRS Research Map | TGRS