Prompting or Fine-tuning? Evaluating Relation Classification in Portuguese for Knowledge Graph Construction

<p>This paper explores relation classification as a step toward building structured knowledge graphs from unstructured Portuguese text. We evaluate prompt-based approaches using generative large language models and compare them with a fine-tuned BERT model. Experiments are conducted on a custom relation extraction dataset built by aligning Wikidata triples with sentences from Wikipedia in Portuguese, a lower-resourced language than English. Results show that while prompt-based methods offer flexibility and reasonable performance, fine-tuning yields significantly better results in identifying relation types, an essential aspect for accurate and reliable knowledge graph construction.</p>

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2025-06-12
DOI
https://doi.org/10.5281/zenodo.16912342
Primary Topic
Geochemistry and Geologic Mapping
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Prompting or Fine-tuning? Evaluating Relation Classification in Portuguese for Knowledge Graph Construction

Zenodo (CERN European Organization for Nuclear Research)
Geochemistry and Geologic Mapping
article

Prompting or Fine-tuning? Evaluating Relation Classification in Portuguese for Knowledge Graph Construction

article en

Abstract

<p>This paper explores relation classification as a step toward building structured knowledge graphs from unstructured Portuguese text. We evaluate prompt-based approaches using generative large language models and compare them with a fine-tuned BERT model. Experiments are conducted on a custom relation extraction dataset built by aligning Wikidata triples with sentences from Wikipedia in Portuguese, a lower-resourced language than English. Results show that while prompt-based methods offer flexibility and reasonable performance, fine-tuning yields significantly better results in identifying relation types, an essential aspect for accurate and reliable knowledge graph construction.</p>

Zenodo (CERN European Organization for Nuclear Research)
Quality Education
Openalex Percentile: Top 67%
Geochemistry and Geologic Mapping
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.