Role-Wise Spatially-Aware Joint Information Extraction with Vocabulary Expansion

Information extraction is the process of transforming unstructured text into structured information. We have observed that entities, events, and relationships within a sentence can be effectively decoded using only the starting and ending pointers. Therefore, we introduce a novel paradigm that treats information extraction as a unified task: span extraction, where relationships are identified by the starting position of one span and the ending position of another. Based on this, we propose one pointer for joint information extraction, which models all tasks using only the head-to-tail pointer. Additionally, we incorporate vocabulary expansion to address the class imbalance problem in the training set, and implicitly models multiple tasks by introducing role-wise spatially-aware subspaces. Experimental results demonstrate that our approach outperforms both task-specific and previous unified models, confirming the effectiveness of our method.

Authors

Institutions

Publication Details

Published
2024-11-22
DOI
https://doi.org/10.1109/icicml63543.2024.10958072
Primary Topic
Natural Language Processing Techniques
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Role-Wise Spatially-Aware Joint Information Extraction with Vocabulary Expansion

Weichang Liu, Ying Zhang, Yufeng Chen, Jinan Xu et al.
Natural Language Processing Techniques
article

Role-Wise Spatially-Aware Joint Information Extraction with Vocabulary Expansion

Weichang Liu, Ying Zhang, Yufeng Chen, Jinan Xu, Jian Liu
article en

Abstract

Information extraction is the process of transforming unstructured text into structured information. We have observed that entities, events, and relationships within a sentence can be effectively decoded using only the starting and ending pointers. Therefore, we introduce a novel paradigm that treats information extraction as a unified task: span extraction, where relationships are identified by the starting position of one span and the ending position of another. Based on this, we propose one pointer for joint information extraction, which models all tasks using only the head-to-tail pointer. Additionally, we incorporate vocabulary expansion to address the class imbalance problem in the training set, and implicitly models multiple tasks by introducing role-wise spatially-aware subspaces. Experimental results demonstrate that our approach outperforms both task-specific and previous unified models, confirming the effectiveness of our method.

Beijing Jiaotong University (CN)
Nature, Fundamental Research Funds for the Central Universities
Quality Education
Openalex Percentile: Top 73%
Natural Language Processing Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.