Overlapping Entity Relation Extraction for Cybersecurity Based on Complex Tagging and Rule-Enhanced Prompt Learning
Cyberspace security is one of the areas that must be prioritized in the development of the Internet and artificial intelligence. The fourth paradigm of “Pre-train, Prompt, Predict” in the field of natural language processing (NLP) has significantly enhanced NLP efficiency and accuracy by shifting downstream tasks from masked to generative, marking a new leap forward. In the realm of cyberspace security, where information flows are vast and multifaceted, the focus of this paper is on extracting multi-relational information among multiple entities. Based on complex tagging and rule-enhanced prompting learning, this paper proposes a method for extracting overlapping entity relationships in cybersecurity. To address the challenges posed by “overlapping entity relationships” and “nested entities” among multiple entities, we have designed a triple extraction model that integrates complex tagging and rule-enhanced prompting learning. This model is a pipeline consisting of three parts: an entity recognition model, a rule injection module, and a relation classification model. The entity recognition model tackles the “nested entity” problem through a multi-label layer and performs entity classification. Rule injection serves two purposes: constraining possible combinations of knowledge triples and constructing prompting learning templates. These templates are input into the relation classification model, which cleverly utilizes suspended position markers to improve model efficiency and maximize the utilization of global semantic information. Finally, the effectiveness of the model is validated on the general dataset DUIE 2.0 and a self-constructed Chinese cybersecurity dataset of overlapping entity relationships.
Authors
- Lehai Xin
- Zhaoyun Ding (ORCID: https://orcid.org/0000-0002-7167-5801)
- Deqi Cao
- Fan Wu (ORCID: https://orcid.org/0000-0003-3615-1217)
- Kai Liu (ORCID: https://orcid.org/0000-0001-7252-5939)
- Fei Wang (ORCID: https://orcid.org/0009-0005-5211-7926)
Institutions
- Central South University (CN)
- National University of Defense Technology (CN)
Publication Details
- Journal
- IEEE Transactions on Cognitive Communications and Networking
- Published
- 2024-11-19
- DOI
- https://doi.org/10.1109/tccn.2024.3502516
- Primary Topic
- Data Quality and Management
- Type
- article
- Field-Weighted Citation Impact
- 0.00