ZeroNER: Fueling Zero-Shot Named Entity Recognition via Entity Type Descriptions

What happens when a named entity recognition (NER) system encounters entities it has never seen before?In practical applications, models must generalize to unseen entity types where labeled training data is either unavailable or severely limited-a challenge that demands zero-shot learning capabilities.While large language models (LLMs) offer extensive parametric knowledge, they fall short in costeffectiveness compared to specialized small encoders.Existing zero-shot methods predominantly adopt a relaxed definition of the term with potential leakage issues and rely on entity type names for generalization, overlooking the value of richer descriptions for disambiguation.In this work, we introduce ZE-RONER, a description-driven framework that enhances hard zero-shot NER in low-resource settings.By leveraging general-domain annotations and entity type descriptions with LLM supervision, ZERONER enables a BERT-based student model to successfully identify unseen entity types.Evaluated on three real-world benchmarks, ZERONER consistently outperforms LLMs by up to 16% in F1 score, and surpasses lightweight baselines that use type names alone.Our analysis further reveals that LLMs derive significant benefits from incorporating type descriptions in the prompts.

Authors

Institutions

Publication Details

Published
2025-01-01
DOI
https://doi.org/10.18653/v1/2025.findings-acl.805
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

ZeroNER: Fueling Zero-Shot Named Entity Recognition via Entity Type Descriptions

Giuseppe Tagliavini, Giacomo Frisoni, Gianluca Moro, Claudio Sartori et al.
Topic Modeling
article

ZeroNER: Fueling Zero-Shot Named Entity Recognition via Entity Type Descriptions

Giuseppe Tagliavini, Giacomo Frisoni, Gianluca Moro, Claudio Sartori, Marcos Martínez Galindo, Alessio Cocchieri
article en

Abstract

What happens when a named entity recognition (NER) system encounters entities it has never seen before?In practical applications, models must generalize to unseen entity types where labeled training data is either unavailable or severely limited-a challenge that demands zero-shot learning capabilities.While large language models (LLMs) offer extensive parametric knowledge, they fall short in costeffectiveness compared to specialized small encoders.Existing zero-shot methods predominantly adopt a relaxed definition of the term with potential leakage issues and rely on entity type names for generalization, overlooking the value of richer descriptions for disambiguation.In this work, we introduce ZE-RONER, a description-driven framework that enhances hard zero-shot NER in low-resource settings.By leveraging general-domain annotations and entity type descriptions with LLM supervision, ZERONER enables a BERT-based student model to successfully identify unseen entity types.Evaluated on three real-world benchmarks, ZERONER consistently outperforms LLMs by up to 16% in F1 score, and surpasses lightweight baselines that use type names alone.Our analysis further reveals that LLMs derive significant benefits from incorporating type descriptions in the prompts.

IBM Research - Ireland (IE)
Fondazione Cassa di Risparmio in Bologna
Openalex Percentile: Top 90%
Topic Modeling
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.