LLM-Based Localization in the Context of Low-Resource Languages
Recent advancements in large language models (LLMs) have enabled the development of systems capable of generating human-like responses across a wide range of tasks. However, research focus has been primarily on high-resource languages such as English, German, and French, whereas low-resource languages have not benefited from these advances. This has created a challenge for localization which requires multinationals to deploy natural language processing-based tools across world-wide geographic footprints. In this paper, we evaluate the state-of-the-art in question-answering for several low-resource Indian languages, including Hindi and Gujarati, and explore a sample Human Resources use case. We focus on neural machine translation based on transfer learning, multilingual meta-learning, and zero-shot approaches, combined with open source LLMs with conversational capabilities.
Authors
- Jorjeta G. Jetcheva
- Hardi Trivedi
- Carlos Rojas (ORCID: https://orcid.org/0000-0002-1906-6048)
Publication Details
- Published
- 2024-09-30
- DOI
- https://doi.org/10.1109/aixset62544.2024.00061
- Citations
- 3
- Primary Topic
- Natural Language Processing Techniques
- Type
- article
- Field-Weighted Citation Impact
- 1.04