Can Uniform Meaning Representation Help GPT-4 Translate from Indigenous Languages?

While ChatGPT and GPT-based models are able to effectively perform many tasks without additional fine-tuning, they struggle with tasks related to extremely low-resource languages and indigenous languages.Uniform Meaning Representation (UMR), a semantic representation designed to capture the meaning of texts in many languages, is well-positioned to be leveraged in the development of lowresource language technologies.In this work, we explore the downstream utility of UMR for low-resource languages by incorporating it into GPT-4 prompts.Specifically, we examine the ability of GPT-4 to perform translation from three indigenous languages (Navajo, Arpaho, and Kukama), with and without demonstrations, as well as with and without UMR annotations.Ultimately, we find that in the majority of our test cases, integrating UMR into the prompt results in a statistically significant increase in performance, which is a promising indication of future applications of the UMR formalism.

Authors

Institutions

Publication Details

Published
2025-01-01
DOI
https://doi.org/10.18653/v1/2025.acl-short.23
Primary Topic
Natural Language Processing Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Can Uniform Meaning Representation Help GPT-4 Translate from Indigenous Languages?

Shira Wein
Natural Language Processing Techniques
article

Can Uniform Meaning Representation Help GPT-4 Translate from Indigenous Languages?

Shira Wein
article en

Abstract

While ChatGPT and GPT-based models are able to effectively perform many tasks without additional fine-tuning, they struggle with tasks related to extremely low-resource languages and indigenous languages.Uniform Meaning Representation (UMR), a semantic representation designed to capture the meaning of texts in many languages, is well-positioned to be leveraged in the development of lowresource language technologies.In this work, we explore the downstream utility of UMR for low-resource languages by incorporating it into GPT-4 prompts.Specifically, we examine the ability of GPT-4 to perform translation from three indigenous languages (Navajo, Arpaho, and Kukama), with and without demonstrations, as well as with and without UMR annotations.Ultimately, we find that in the majority of our test cases, integrating UMR into the prompt results in a statistically significant increase in performance, which is a promising indication of future applications of the UMR formalism.

Amherst College (US)
Quality Education
Openalex Percentile: Top 90%
Natural Language Processing Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Can Uniform Meaning Representation Help GPT-4 Translate from Indigenous Languages? — Shira Wein · (2025) | TGRS Research Map | TGRS