ACAM: An Adaptive Context-aware Attention Module for Nested Named Entity Recognition

Named Entity Recognition (NER) is a key task in natural language processing. It aims to find entity boundaries and predefined entity types in text. For nested NER tasks, it is difficult to achieve both high accuracy and efficiency. Span-based NER methods are common deep learning approaches. They are effective for handling nested entities, but they face semantic fragmentation issues with long spans. Convolutional Neural Networks (CNN) can capture local context, but their fixed receptive fields and weights limit their ability to handle long-range dependencies. To solve this problem, we propose a new Adaptive Context-aware Attention Module (ACAM). This module adjusts sampling points and uses a multi-head separation strategy to extract local and long-range features from different directions. By focusing on important areas in span matrices, it improves entity representations and reduces semantic loss. We combined the ACAM with a contrastive learning-based NER model and tested it on the ACE 2004 and ACE 2005 datasets. The results show that it performs better than baseline methods, achieving F1 scores of 89.2% and 90.0% respectively. Ablation studies show that both adaptive sampling and multi-head separation strategies help capture complex patterns and improve span features.

Authors

Institutions

Publication Details

Published
2025-03-14
DOI
https://doi.org/10.1145/3746709.3746769
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

ACAM: An Adaptive Context-aware Attention Module for Nested Named Entity Recognition

Yuexing Han, Qiaochuan Chen, Rui Zhang, Chenfan Ling
Topic Modeling
article

ACAM: An Adaptive Context-aware Attention Module for Nested Named Entity Recognition

Yuexing Han, Qiaochuan Chen, Rui Zhang, Chenfan Ling
article en

Abstract

Named Entity Recognition (NER) is a key task in natural language processing. It aims to find entity boundaries and predefined entity types in text. For nested NER tasks, it is difficult to achieve both high accuracy and efficiency. Span-based NER methods are common deep learning approaches. They are effective for handling nested entities, but they face semantic fragmentation issues with long spans. Convolutional Neural Networks (CNN) can capture local context, but their fixed receptive fields and weights limit their ability to handle long-range dependencies. To solve this problem, we propose a new Adaptive Context-aware Attention Module (ACAM). This module adjusts sampling points and uses a multi-head separation strategy to extract local and long-range features from different directions. By focusing on important areas in span matrices, it improves entity representations and reduces semantic loss. We combined the ACAM with a contrastive learning-based NER model and tested it on the ACE 2004 and ACE 2005 datasets. The results show that it performs better than baseline methods, achieving F1 scores of 89.2% and 90.0% respectively. Ablation studies show that both adaptive sampling and multi-head separation strategies help capture complex patterns and improve span features.

Shanghai University of Engineering Science (CN)
Openalex Percentile: Top 88%
Topic Modeling
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.