LLM-NER: Advancing Named Entity Recognition with LoRA+ Fine-Tuned Large Language Models

Named Entity Recognition (NER) is a crucial task in natural language processing, but it faces persistent challenges in deep learning approaches, such as ambiguity, entity overlap, and domain variability. This study explores the potential of large language models (LLMs) to address these challenges by leveraging LoRA (Low-Rank Adaptation) and LoRA+ fine-tuning techniques. We present a specialized fine-tuned LLM based on Meta-Llama-3-8B-Instruct, optimized for NER tasks. Our model is evaluated against three benchmarks—BERT, RoBERTa, and DeBERTa—and demonstrates competitive performance using prompting alone. Moreover, the fine-tuned model with LoRA+ surpasses benchmark models by $10 \%$ in F1 score, showcasing its ability to distinguish nuanced entities effectively. These findings highlight the potential of LLMs in redefining the state of the art for NER tasks, enabling more robust and adaptable entity recognition solutions.

Authors

Institutions

Publication Details

Published
2025-03-28
DOI
https://doi.org/10.1109/iccai66501.2025.00063
Citations
16
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
39.70
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

LLM-NER: Advancing Named Entity Recognition with LoRA+ Fine-Tuned Large Language Models

Yi Zhu, Yunan Liu
16 citations
Topic Modeling
39.70
article

LLM-NER: Advancing Named Entity Recognition with LoRA+ Fine-Tuned Large Language Models

Yi Zhu, Yunan Liu
article en
16 citations

Abstract

Named Entity Recognition (NER) is a crucial task in natural language processing, but it faces persistent challenges in deep learning approaches, such as ambiguity, entity overlap, and domain variability. This study explores the potential of large language models (LLMs) to address these challenges by leveraging LoRA (Low-Rank Adaptation) and LoRA+ fine-tuning techniques. We present a specialized fine-tuned LLM based on Meta-Llama-3-8B-Instruct, optimized for NER tasks. Our model is evaluated against three benchmarks—BERT, RoBERTa, and DeBERTa—and demonstrates competitive performance using prompting alone. Moreover, the fine-tuned model with LoRA+ surpasses benchmark models by $10 \%$ in F1 score, showcasing its ability to distinguish nuanced entities effectively. These findings highlight the potential of LLMs in redefining the state of the art for NER tasks, enabling more robust and adaptable entity recognition solutions.

Social Science Research Council (US), Duke University (US)
Openalex Percentile: Top 0%
Topic Modeling
39.70
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.