Effective In-Context Learning for Named Entity Recognition

Named entity recognition aims to identify meaningful words or phrases from text. Traditional NER methods depend heavily on training datasets to learn entity features, which often leads to poor performance in recognizing low-resource entities. Large language models offer a promising solution in low-resource scenarios, but they struggle with entity boundary recognition and often suffer from hallucination issues due to their reliance on general-purpose corpora. In this paper, we propose a novel approach that enhances LLMs’ performance in NER by integrating a boundary regularity extraction algorithm and an explanatory path extraction method. The boundary regularity algorithm leverages ChatGPT’s summarization capabilities to articulate entity boundaries in natural language, improving boundary detection accuracy. The explanatory path method constructs logical reasoning steps from text to entity recognition, guiding LLMs to generate more accurate predictions and mitigating hallucination problems. Extensive experiments on three public datasets demonstrate that our method outperforms current mainstream LLMs in accurately recognizing entities from unstructured text. These findings validate the effectiveness of our approach and its potential to address key challenges in NER.

Authors

Institutions

Publication Details

Published
2024-12-03
DOI
https://doi.org/10.1109/bibm62325.2024.10822520
Citations
1
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
0.35
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Effective In-Context Learning for Named Entity Recognition

Jin Zhao, Zhixu Li, Jiaqing Liang, Qian Guo et al.
1 citations
Topic Modeling
0.35
article

Effective In-Context Learning for Named Entity Recognition

Jin Zhao, Zhixu Li, Jiaqing Liang, Qian Guo, Yanghua Xiao
article en
1 citations

Abstract

Named entity recognition aims to identify meaningful words or phrases from text. Traditional NER methods depend heavily on training datasets to learn entity features, which often leads to poor performance in recognizing low-resource entities. Large language models offer a promising solution in low-resource scenarios, but they struggle with entity boundary recognition and often suffer from hallucination issues due to their reliance on general-purpose corpora. In this paper, we propose a novel approach that enhances LLMs’ performance in NER by integrating a boundary regularity extraction algorithm and an explanatory path extraction method. The boundary regularity algorithm leverages ChatGPT’s summarization capabilities to articulate entity boundaries in natural language, improving boundary detection accuracy. The explanatory path method constructs logical reasoning steps from text to entity recognition, guiding LLMs to generate more accurate predictions and mitigating hallucination problems. Extensive experiments on three public datasets demonstrate that our method outperforms current mainstream LLMs in accurately recognizing entities from unstructured text. These findings validate the effectiveness of our approach and its potential to address key challenges in NER.

Fuyang Normal University (CN), Fudan University (CN), Renmin University of China (CN)
Openalex Percentile: Top 30%
Topic Modeling
0.35
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Effective In-Context Learning for Named Entity Recognition — Jin Zhao, Zhixu Li, et al. · (2024) | TGRS Research Map | TGRS