Addressing Span Imbalance and Semantic Complexity in Nested Medical Named Entity Recognition

As a fundamental task in biomedical natural language processing, Medical Named Entity Recognition (MNER) aims to identify and classify medical entities from unstructured medical texts. A major challenge in this task is the prevalence of nested entities, which arise from the syntactic complexity and domain-specific characteristics of medical language. Recently, span-based models have been proposed to handle nested entities by reformulating the task as a multi-label classification problem over all possible spans. However, when directly applied to medical texts, these models encounter two problems. First, existing span-based methods typically rely on general-domain pre-trained language models to learn textual semantics, which hinders their ability to capture contextual dependencies in complex medical texts, thereby limiting their generalization across diverse medical data. Second, these methods treat all candidate spans equally during training, which results in an underestimation of the gradient contributions from entity spans due to their relatively small proportion, thereby degrading recognition performance. To address these issues, we propose AGPNer, a novel method for recognizing nested medical named entities. The proposed AGPNer integrates two key components: (1) a heterogeneous dependency fusion encoder, which reconstructs masked entities to enhance token representations and fine-tunes a hybrid dependency modeling block to learn domain-specific patterns in medical texts; (2) an imbalance-adaptive span decoder, which decouples entity and non-entity spans and adaptively assigns them different exponential decay factors to regulate their contributions during training. Experimental results on four public benchmarks demonstrate that AGPNer achieves absolute improvements in F1-score of 0.90, 1.02, 0.47 and 0.75 percentage points on CMeEE-V1, CMeEE-V2, GENIA, and CLUENER, respectively, showing consistent and competitive performance among the compared baselines.

Authors

Institutions

Publication Details

Journal
ACM Transactions on Intelligent Systems and Technology
Published
2026-09-19
DOI
https://doi.org/10.1145/3848503
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
article

Addressing Span Imbalance and Semantic Complexity in Nested Medical Named Entity Recognition

Fei Yang, Ji Chang, Yīmíng Bào, Yuling Li et al.
ACM Transactions on Intelligent Systems and Technology
Topic Modeling
article

Addressing Span Imbalance and Semantic Complexity in Nested Medical Named Entity Recognition

Fei Yang, Ji Chang, Yīmíng Bào, Yuling Li, Kui Yu, Zerui Li, Zi Wang, Yangjuan Hu
article en

Abstract

As a fundamental task in biomedical natural language processing, Medical Named Entity Recognition (MNER) aims to identify and classify medical entities from unstructured medical texts. A major challenge in this task is the prevalence of nested entities, which arise from the syntactic complexity and domain-specific characteristics of medical language. Recently, span-based models have been proposed to handle nested entities by reformulating the task as a multi-label classification problem over all possible spans. However, when directly applied to medical texts, these models encounter two problems. First, existing span-based methods typically rely on general-domain pre-trained language models to learn textual semantics, which hinders their ability to capture contextual dependencies in complex medical texts, thereby limiting their generalization across diverse medical data. Second, these methods treat all candidate spans equally during training, which results in an underestimation of the gradient contributions from entity spans due to their relatively small proportion, thereby degrading recognition performance. To address these issues, we propose AGPNer, a novel method for recognizing nested medical named entities. The proposed AGPNer integrates two key components: (1) a heterogeneous dependency fusion encoder, which reconstructs masked entities to enhance token representations and fine-tunes a hybrid dependency modeling block to learn domain-specific patterns in medical texts; (2) an imbalance-adaptive span decoder, which decouples entity and non-entity spans and adaptively assigns them different exponential decay factors to regulate their contributions during training. Experimental results on four public benchmarks demonstrate that AGPNer achieves absolute improvements in F1-score of 0.90, 1.02, 0.47 and 0.75 percentage points on CMeEE-V1, CMeEE-V2, GENIA, and CLUENER, respectively, showing consistent and competitive performance among the compared baselines.

ACM Transactions on Intelligent Systems and Technology
University of Science and Technology of China (CN), Hefei University of Technology (CN), Anhui Medical University (CN)
Quality Education
Openalex Percentile: Top 8%
Topic Modeling
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.