Drilling risk named entity recognition based on RoBERTa-BiLSTM-CRF

Traditional methods for named entity recognition in the construction of a drilling risk knowledge graph face challenges regarding feature extraction accuracy and recognition efficiency. To overcome these issues, a research method based on the RoBERTa-BiLSTM-CRF model is proposed. This method utilizes RoBERTa for word embeddings and applies a BiLSTM network for contextual feature extraction. The Conditional Random Field (CRF) is used for sequence labeling, resulting in a named entity recognition framework for the drilling risk domain. Comparative experiments were conducted on a self-built dataset, comparing the RoBERTa-BiLSTM-CRF model with RoBERTa-BiLSTM and BERT-BiLSTMCRF. The results demonstrate that the RoBERTa-BiLSTM-CRF model achieves superior precision, recall, and F1-score of 89.7%, 89.3%, and 89.1%, outperforming the other models in terms of entity recognition performance.

Authors

Institutions

Publication Details

Published
2024-08-16
DOI
https://doi.org/10.1117/12.3035586
Citations
1
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
0.35
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Drilling risk named entity recognition based on RoBERTa-BiLSTM-CRF

Yingzhuo Xu, Lili Zhang
1 citations
Topic Modeling
0.35
article

Drilling risk named entity recognition based on RoBERTa-BiLSTM-CRF

Yingzhuo Xu, Lili Zhang
article en
1 citations

Abstract

Traditional methods for named entity recognition in the construction of a drilling risk knowledge graph face challenges regarding feature extraction accuracy and recognition efficiency. To overcome these issues, a research method based on the RoBERTa-BiLSTM-CRF model is proposed. This method utilizes RoBERTa for word embeddings and applies a BiLSTM network for contextual feature extraction. The Conditional Random Field (CRF) is used for sequence labeling, resulting in a named entity recognition framework for the drilling risk domain. Comparative experiments were conducted on a self-built dataset, comparing the RoBERTa-BiLSTM-CRF model with RoBERTa-BiLSTM and BERT-BiLSTMCRF. The results demonstrate that the RoBERTa-BiLSTM-CRF model achieves superior precision, recall, and F1-score of 89.7%, 89.3%, and 89.1%, outperforming the other models in terms of entity recognition performance.

Xi'an Shiyou University (CN)
Climate action
Openalex Percentile: Top 35%
Topic Modeling
0.35
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.