Research on BERT-Based Named Entity Method for Network Security
In the field of cybersecurity information, there are numerous challenges such as a large amount of redundant information, ambiguous entity boundaries, and polysemy. We propose a named entity recognition (NER) model based on the BERT-BiLSTM-MVCA-CRF architecture for the cybersecurity domain. First, we use the BERT pre-trained model to obtain dynamic word embeddings. These word embeddings are then used as input to a BiLSTM network to capture contextual feature vectors of the text. Furthermore, we introduce the MVCA mechanism to fully capture multi-scale spatial information and different channel correlations. Finally, the processed results are fed into a CRF layer for labeling. To validate the effectiveness of the model, we conducted a series of experiments using a cybersecurity dataset. The results showed a significant improvement, with the F1 score reaching 89.22%, outperforming other NER models.
Authors
- Liang Zhang (ORCID: https://orcid.org/0000-0002-1966-0864)
- Meng Meng (ORCID: https://orcid.org/0000-0002-4828-2663)
- Lihong Peng (ORCID: https://orcid.org/0000-0002-3905-7085)
- Teng Yi
Publication Details
- Published
- 2024-09-20
- DOI
- https://doi.org/10.1109/itnec60942.2024.10732930
- Primary Topic
- Network Packet Processing and Optimization
- Type
- article
- Field-Weighted Citation Impact
- 0.00