Enhancing named entity recognition with a novel BERT‐BiLSTM‐CRF‐RC joint training model for biomedical materials database

Abstract In this study, we propose a novel joint training model for named entity recognition (NER) that combines BERT, BiLSTM, CRF, and a reading comprehension (RC) mechanism. Traditional BERT‐BiLSTM‐CRF models often struggle with inaccurate boundary detection and excessive fragmentation of named entities due to their lack of specialized vocabulary. Our model addresses these issues by integrating an RC mechanism, which helps refine fragmented results by enabling the model to more precisely identify entity boundaries without relying on an expert‐annotated dictionary. Additionally, segmentation issues are further mitigated through a segmented combined voting‐ and positive‐sample‐coverage technique. We applied this model to develop a database for mesoporous bioactive glass (MBG). Furthermore, a classifier was developed to automatically detect the presence of pertinent information within paragraphs. For this study, 200 articles were searched using MBG‐related keywords, and the data were split into a training set and a test set in a 9:1 ratio. A total of 492 paragraphs were automatically extracted for training, and 50 paragraphs were extracted for testing the model. The results demonstrate that our joint training model achieves an accuracy of 92.8% in named entity recognition, which is 4.3% higher than the 88.5% accuracy of the traditional BERT‐BiLSTM‐CRF model.

Authors

Institutions

Publication Details

Journal
Materials Genome Engineering Advances
Published
2025-03-01
DOI
https://doi.org/10.1002/mgea.70001
Citations
1
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
2.48
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Enhancing named entity recognition with a novel BERT‐BiLSTM‐CRF‐RC joint training model for biomedical materials database

Yan Zhuang, Xiangdong Zhu, Mingli Yang, Lin Han et al.
1 citations
Materials Genome Engineering Advances
Topic Modeling
2.48
article

Enhancing named entity recognition with a novel BERT‐BiLSTM‐CRF‐RC joint training model for biomedical materials database

Yan Zhuang, Xiangdong Zhu, Mingli Yang, Lin Han, Guangfu Yin, Yutuo Wei, Ke Chen, Lin Jiang-li, Xiangfeng Li, Mufei Li, Xingdong Zhang
article en
1 citations

Abstract

Abstract In this study, we propose a novel joint training model for named entity recognition (NER) that combines BERT, BiLSTM, CRF, and a reading comprehension (RC) mechanism. Traditional BERT‐BiLSTM‐CRF models often struggle with inaccurate boundary detection and excessive fragmentation of named entities due to their lack of specialized vocabulary. Our model addresses these issues by integrating an RC mechanism, which helps refine fragmented results by enabling the model to more precisely identify entity boundaries without relying on an expert‐annotated dictionary. Additionally, segmentation issues are further mitigated through a segmented combined voting‐ and positive‐sample‐coverage technique. We applied this model to develop a database for mesoporous bioactive glass (MBG). Furthermore, a classifier was developed to automatically detect the presence of pertinent information within paragraphs. For this study, 200 articles were searched using MBG‐related keywords, and the data were split into a training set and a test set in a 9:1 ratio. A total of 492 paragraphs were automatically extracted for training, and 50 paragraphs were extracted for testing the model. The results demonstrate that our joint training model achieves an accuracy of 92.8% in named entity recognition, which is 4.3% higher than the 88.5% accuracy of the traditional BERT‐BiLSTM‐CRF model.

Materials Genome Engineering AdvancesVol. 3(1)
Sichuan University (CN)
Openalex Percentile: Top 11%
Topic Modeling
2.48
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.