Joint Extraction of Interaction Features and Attention Mechanism Fused with Entity-Relations

Joint extraction of entities and relations is an essential task in information extraction.Recently, tagging-based models have gained attention but with poor performance on overlapping triplets, which confronted the issues like cascading errors, information redundancy, and sensitivity to subject extraction.To solve the issue of overlapping triplets, we propose a model combined Gated Attention Unit (GAU) and Multihead Attention Mechanism (MHA) in this paper.This model distinguishes features for entities and relations, and performs entity recognition for each head entity, different head entities are matched to the same or different tail entities.Then specific tail entity tagging is applied to determine all possible relations and corresponding tails.At the same time, in order to better solve the long-distance dependence and complex multiple relations between entities, GAU and MHA are used to enhance the semantic representation, effectively identify entities and relations, and enhance the learning ability and generalization ability of the model.Experiment results on the public datasets DuIE2.0 and CMeIE show that our model performs better than baselines.

Authors

Publication Details

Journal
Proceedings/Proceedings of the ... International Conference on Software Engineering and Knowledge Engineering
Published
2024-10-28
DOI
https://doi.org/10.18293/seke2024-119
Primary Topic
Advanced Text Analysis Techniques
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Joint Extraction of Interaction Features and Attention Mechanism Fused with Entity-Relations

Lisha Su, Rong Yan
Proceedings/Proceedings of the ... International Conference on Software Engineering and Knowledge Engineering
Advanced Text Analysis Techniques
article

Joint Extraction of Interaction Features and Attention Mechanism Fused with Entity-Relations

Lisha Su, Rong Yan
article en

Abstract

Joint extraction of entities and relations is an essential task in information extraction.Recently, tagging-based models have gained attention but with poor performance on overlapping triplets, which confronted the issues like cascading errors, information redundancy, and sensitivity to subject extraction.To solve the issue of overlapping triplets, we propose a model combined Gated Attention Unit (GAU) and Multihead Attention Mechanism (MHA) in this paper.This model distinguishes features for entities and relations, and performs entity recognition for each head entity, different head entities are matched to the same or different tail entities.Then specific tail entity tagging is applied to determine all possible relations and corresponding tails.At the same time, in order to better solve the long-distance dependence and complex multiple relations between entities, GAU and MHA are used to enhance the semantic representation, effectively identify entities and relations, and enhance the learning ability and generalization ability of the model.Experiment results on the public datasets DuIE2.0 and CMeIE show that our model performs better than baselines.

Proceedings/Proceedings of the ... International Conference on Software Engineering and Knowledge EngineeringVol. 2024
Natural Science Foundation of Inner Mongolia
Reduced inequalities
Openalex Percentile: Top 77%
Advanced Text Analysis Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.