Overlapping Entity Relation Extraction for Cybersecurity Based on Complex Tagging and Rule-Enhanced Prompt Learning

Cyberspace security is one of the areas that must be prioritized in the development of the Internet and artificial intelligence. The fourth paradigm of “Pre-train, Prompt, Predict” in the field of natural language processing (NLP) has significantly enhanced NLP efficiency and accuracy by shifting downstream tasks from masked to generative, marking a new leap forward. In the realm of cyberspace security, where information flows are vast and multifaceted, the focus of this paper is on extracting multi-relational information among multiple entities. Based on complex tagging and rule-enhanced prompting learning, this paper proposes a method for extracting overlapping entity relationships in cybersecurity. To address the challenges posed by “overlapping entity relationships” and “nested entities” among multiple entities, we have designed a triple extraction model that integrates complex tagging and rule-enhanced prompting learning. This model is a pipeline consisting of three parts: an entity recognition model, a rule injection module, and a relation classification model. The entity recognition model tackles the “nested entity” problem through a multi-label layer and performs entity classification. Rule injection serves two purposes: constraining possible combinations of knowledge triples and constructing prompting learning templates. These templates are input into the relation classification model, which cleverly utilizes suspended position markers to improve model efficiency and maximize the utilization of global semantic information. Finally, the effectiveness of the model is validated on the general dataset DUIE 2.0 and a self-constructed Chinese cybersecurity dataset of overlapping entity relationships.

Authors

Institutions

Publication Details

Journal
IEEE Transactions on Cognitive Communications and Networking
Published
2024-11-19
DOI
https://doi.org/10.1109/tccn.2024.3502516
Primary Topic
Data Quality and Management
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Overlapping Entity Relation Extraction for Cybersecurity Based on Complex Tagging and Rule-Enhanced Prompt Learning

Lehai Xin, Zhaoyun Ding, Deqi Cao, Fan Wu et al.
IEEE Transactions on Cognitive Communications and Networking
Data Quality and Management
article

Overlapping Entity Relation Extraction for Cybersecurity Based on Complex Tagging and Rule-Enhanced Prompt Learning

Lehai Xin, Zhaoyun Ding, Deqi Cao, Fan Wu, Kai Liu, Fei Wang
article en

Abstract

Cyberspace security is one of the areas that must be prioritized in the development of the Internet and artificial intelligence. The fourth paradigm of “Pre-train, Prompt, Predict” in the field of natural language processing (NLP) has significantly enhanced NLP efficiency and accuracy by shifting downstream tasks from masked to generative, marking a new leap forward. In the realm of cyberspace security, where information flows are vast and multifaceted, the focus of this paper is on extracting multi-relational information among multiple entities. Based on complex tagging and rule-enhanced prompting learning, this paper proposes a method for extracting overlapping entity relationships in cybersecurity. To address the challenges posed by “overlapping entity relationships” and “nested entities” among multiple entities, we have designed a triple extraction model that integrates complex tagging and rule-enhanced prompting learning. This model is a pipeline consisting of three parts: an entity recognition model, a rule injection module, and a relation classification model. The entity recognition model tackles the “nested entity” problem through a multi-label layer and performs entity classification. Rule injection serves two purposes: constraining possible combinations of knowledge triples and constructing prompting learning templates. These templates are input into the relation classification model, which cleverly utilizes suspended position markers to improve model efficiency and maximize the utilization of global semantic information. Finally, the effectiveness of the model is validated on the general dataset DUIE 2.0 and a self-constructed Chinese cybersecurity dataset of overlapping entity relationships.

IEEE Transactions on Cognitive Communications and NetworkingVol. 11(2)
Central South University (CN), National University of Defense Technology (CN)
Reduced inequalities
Openalex Percentile: Top 75%
Data Quality and Management
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.