Improving Named Entity Recognition for Low-Resource Languages Using Large Language Models: A Ukrainian Case Study

Named Entity Recognition (NER) is a fundamental task in Natural Language Processing (NLP), yet achieving high performance for lowresource languages remains challenging due to limited annotated data and linguistic complexity.Ukrainian exemplifies these issues with its rich morphology and scarce NLP resources.Recent advances in Large Language Models (LLMs) demonstrate their ability to generalize across diverse languages and domains, offering promising solutions without extensive annotations.This research explores adapting state-of-the-art LLMs to Ukrainian through prompt engineering, including chainof-thought (CoT) strategies, and model refinement via Supervised Fine-Tuning (SFT).Our best model achieves 0.89 F 1 on the NER-UK 2.0 benchmark, matching the performance of advanced encoder-only baselines.These findings highlight practical pathways for improving NER in low-resource contexts, promoting more accessible and scalable language technologies.

Authors

Publication Details

Published
2025-01-01
DOI
https://doi.org/10.18653/v1/2025.unlp-1.3
Citations
1
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
2.48
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Improving Named Entity Recognition for Low-Resource Languages Using Large Language Models: A Ukrainian Case Study

Vladyslav Radchenko, Nazarii Drushchak
1 citations
Topic Modeling
2.48
article

Improving Named Entity Recognition for Low-Resource Languages Using Large Language Models: A Ukrainian Case Study

Vladyslav Radchenko, Nazarii Drushchak
article en
1 citations

Abstract

Named Entity Recognition (NER) is a fundamental task in Natural Language Processing (NLP), yet achieving high performance for lowresource languages remains challenging due to limited annotated data and linguistic complexity.Ukrainian exemplifies these issues with its rich morphology and scarce NLP resources.Recent advances in Large Language Models (LLMs) demonstrate their ability to generalize across diverse languages and domains, offering promising solutions without extensive annotations.This research explores adapting state-of-the-art LLMs to Ukrainian through prompt engineering, including chainof-thought (CoT) strategies, and model refinement via Supervised Fine-Tuning (SFT).Our best model achieves 0.89 F 1 on the NER-UK 2.0 benchmark, matching the performance of advanced encoder-only baselines.These findings highlight practical pathways for improving NER in low-resource contexts, promoting more accessible and scalable language technologies.

Openalex Percentile: Top 9%
Topic Modeling
2.48
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.