When the Dictionary Strikes Back: A Case Study on Slovak Migration Location Term Extraction and NER via Rule-Based vs. LLM Methods

This study explores the task of automatically extracting migration-related locations (source and destination) from media articles, focusing on the challenges posed by Slovak, a low-resource and morphologically complex language.We present the first comparative analysis of rule-based dictionary approaches (NLP4SK) versus Large Language Models (LLMs, e.g.SlovakBERT, GPT-4o) for both geographical relevance classification (Slovakiafocused migration) and specific source/target location extraction.To facilitate this research and future work, we introduce the first manually annotated Slovak dataset tailored for migration-focused locality detection.Our results show that while a fine-tuned SlovakBERT model achieves high accuracy for classification, specialized rule-based methods still have the potential to outperform LLMs for specific extraction tasks, though improved LLM performance with few-shot examples suggests future competitiveness as research in this area continues to evolve.

Authors

Publication Details

Published
2025-01-01
DOI
https://doi.org/10.18653/v1/2025.bsnlp-1.11
Primary Topic
Data Quality and Management
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

When the Dictionary Strikes Back: A Case Study on Slovak Migration Location Term Extraction and NER via Rule-Based vs. LLM Methods

Andrej Findor, Jaroslav Kopčan, Marián Šimko, Martin Takáč et al.
Data Quality and Management
article

When the Dictionary Strikes Back: A Case Study on Slovak Migration Location Term Extraction and NER via Rule-Based vs. LLM Methods

Andrej Findor, Jaroslav Kopčan, Marián Šimko, Martin Takáč, Miroslav Blšták, Marek Šuppa, Samuel Havran
article en

Abstract

This study explores the task of automatically extracting migration-related locations (source and destination) from media articles, focusing on the challenges posed by Slovak, a low-resource and morphologically complex language.We present the first comparative analysis of rule-based dictionary approaches (NLP4SK) versus Large Language Models (LLMs, e.g.SlovakBERT, GPT-4o) for both geographical relevance classification (Slovakiafocused migration) and specific source/target location extraction.To facilitate this research and future work, we introduce the first manually annotated Slovak dataset tailored for migration-focused locality detection.Our results show that while a fine-tuned SlovakBERT model achieves high accuracy for classification, specialized rule-based methods still have the potential to outperform LLMs for specific extraction tasks, though improved LLM performance with few-shot examples suggests future competitiveness as research in this area continues to evolve.

Agentúra na Podporu Výskumu a Vývoja
Reduced inequalities
Openalex Percentile: Top 77%
Data Quality and Management
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.