Role-Wise Spatially-Aware Joint Information Extraction with Vocabulary Expansion
Information extraction is the process of transforming unstructured text into structured information. We have observed that entities, events, and relationships within a sentence can be effectively decoded using only the starting and ending pointers. Therefore, we introduce a novel paradigm that treats information extraction as a unified task: span extraction, where relationships are identified by the starting position of one span and the ending position of another. Based on this, we propose one pointer for joint information extraction, which models all tasks using only the head-to-tail pointer. Additionally, we incorporate vocabulary expansion to address the class imbalance problem in the training set, and implicitly models multiple tasks by introducing role-wise spatially-aware subspaces. Experimental results demonstrate that our approach outperforms both task-specific and previous unified models, confirming the effectiveness of our method.
Authors
- Weichang Liu (ORCID: https://orcid.org/0000-0002-3829-6690)
- Ying Zhang (ORCID: https://orcid.org/0000-0003-0688-2502)
- Yufeng Chen (ORCID: https://orcid.org/0000-0003-0437-6788)
- Jinan Xu (ORCID: https://orcid.org/0000-0003-0170-626X)
- Jian Liu (ORCID: https://orcid.org/0000-0002-4728-5678)
Institutions
- Beijing Jiaotong University (CN)
Publication Details
- Published
- 2024-11-22
- DOI
- https://doi.org/10.1109/icicml63543.2024.10958072
- Primary Topic
- Natural Language Processing Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Nature
- Fundamental Research Funds for the Central Universities