Exploring Named Entity Recognition via MacBERT-BiGRU and Global Pointer with Self-Attention

Named Entity Recognition (NER) is a fundamental task in natural language processing that aims to identify and categorize named entities within unstructured text. In recent years, with the development of deep learning techniques, pre-trained language models have been widely used in NER tasks. However, these models still face limitations in terms of their scalability and adaptability, especially when dealing with complex linguistic phenomena such as nested entities and long-range dependencies. To address these challenges, we propose the MacBERT-BiGRU-Self Attention-Global Pointer (MB-GAP) model, which integrates MacBERT for deep semantic understanding, BiGRU for rich contextual information, self-attention for focusing on relevant parts of the input, and a global pointer mechanism for precise entity boundary detection. By optimizing the number of attention heads and global pointer heads, our model achieves an effective balance between complexity and performance. Extensive experiments on benchmark datasets, including ResumeNER, CLUENER2020, and SCHOLAT-School, demonstrate significant improvements over baseline models.

Authors

Institutions

Publication Details

Journal
Big Data and Cognitive Computing
Published
2024-12-03
DOI
https://doi.org/10.3390/bdcc8120179
Citations
3
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
1.04

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Exploring Named Entity Recognition via MacBERT-BiGRU and Global Pointer with Self-Attention

Chengzhe Yuan, Ronghua Lin, Chengjie Mao, Weiqiang Shen et al.
3 citations
Big Data and Cognitive Computing
Topic Modeling
1.04
article

Exploring Named Entity Recognition via MacBERT-BiGRU and Global Pointer with Self-Attention

Chengzhe Yuan, Ronghua Lin, Chengjie Mao, Weiqiang Shen, Feiyi Tang, Chun Shan, Junxian Li
article en
3 citations

Abstract

Named Entity Recognition (NER) is a fundamental task in natural language processing that aims to identify and categorize named entities within unstructured text. In recent years, with the development of deep learning techniques, pre-trained language models have been widely used in NER tasks. However, these models still face limitations in terms of their scalability and adaptability, especially when dealing with complex linguistic phenomena such as nested entities and long-range dependencies. To address these challenges, we propose the MacBERT-BiGRU-Self Attention-Global Pointer (MB-GAP) model, which integrates MacBERT for deep semantic understanding, BiGRU for rich contextual information, self-attention for focusing on relevant parts of the input, and a global pointer mechanism for precise entity boundary detection. By optimizing the number of attention heads and global pointer heads, our model achieves an effective balance between complexity and performance. Extensive experiments on benchmark datasets, including ResumeNER, CLUENER2020, and SCHOLAT-School, demonstrate significant improvements over baseline models.

Big Data and Cognitive ComputingVol. 8(12)
South China Normal University (CN), Guangzhou Panyu Polytechnic (CN), Guangdong Polytechnic Normal University (CN)
Guangdong Polytechnic Normal University
Quality Education
Openalex Percentile: Top 18%
Topic Modeling
1.04
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.