Fine-Tuning Large Language Models and Machine Learning for Extracting Entities and Relationships in Spanish Medical Texts

In this paper, we delve into the techniques used to extract information from medical texts written in Spanish. Our study focuses on fine-tuning Large Language Models by training them on Spanish medical texts and adjusting various hyperparameters. We also explore traditional machine learning algorithms like support vector machines, decision trees, and nearest neighbours. Our analysis aims to evaluate the tool's ability to identify entities and relationships between them. Our results show that the support vector machine algorithm outperformed Large Language Models in entity identification, achieving a 78.72% F1 score compared to 68.04%. However, Large Language Models demonstrated superior performance in relationship identification, achieving a 57.15% F1 score compared to 35.5% for machine learning algorithms.

Authors

Publication Details

Journal
International Journal of Combinatorial Optimization Problems and Informatics.
Published
2025-10-12
DOI
https://doi.org/10.61467/2007.1558.2025.v16i4.575
Primary Topic
Natural Language Processing Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Fine-Tuning Large Language Models and Machine Learning for Extracting Entities and Relationships in Spanish Medical Texts

Maricela Bravo, José A. Reyes‐Ortiz, Nidia K. Serafin-Rojas, Jousé Padilla-Cuevas
International Journal of Combinatorial Optimization Problems and Informatics.
Natural Language Processing Techniques
article

Fine-Tuning Large Language Models and Machine Learning for Extracting Entities and Relationships in Spanish Medical Texts

Maricela Bravo, José A. Reyes‐Ortiz, Nidia K. Serafin-Rojas, Jousé Padilla-Cuevas
article en

Abstract

In this paper, we delve into the techniques used to extract information from medical texts written in Spanish. Our study focuses on fine-tuning Large Language Models by training them on Spanish medical texts and adjusting various hyperparameters. We also explore traditional machine learning algorithms like support vector machines, decision trees, and nearest neighbours. Our analysis aims to evaluate the tool's ability to identify entities and relationships between them. Our results show that the support vector machine algorithm outperformed Large Language Models in entity identification, achieving a 78.72% F1 score compared to 68.04%. However, Large Language Models demonstrated superior performance in relationship identification, achieving a 57.15% F1 score compared to 35.5% for machine learning algorithms.

International Journal of Combinatorial Optimization Problems and Informatics.Vol. 16(4)
Openalex Percentile: Top 85%
Natural Language Processing Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.