An improved GPT2-based joint event extraction method with position expansion and knowledge augmentation

With the rapid development of the Internet and social media, massive amounts of unstructured data have emerged, making event extraction increasingly important for information retrieval. In the financial domain, challenges such as long texts, redundant content, and complex structures hinder extraction tasks. To address this, we propose PosEKE-GPT2, an improved GPT2-based model that reformulates event extraction as a text generation task. The model jointly identifies event types, triggers, and arguments using structured canonical text and a sub-task extraction strategy to reduce error propagation. An expanded positional encoding mechanism enhances event representation in long texts. Furthermore, we introduce a knowledge augmentation module that dynamically selects and integrates external knowledge via prompt mechanisms and attention-based embedding optimization. Experiments on the DuEE-Fin dataset show that PosEKE-GPT2 achieves an average F1-score of 90.61, while on the FewFC dataset it reaches an average F1-score of 88.85, both outperforming baseline models. Ablation studies verify the effectiveness of the positional encoding and knowledge augmentation modules, demonstrating the model's robustness and suitability for financial event extraction across different datasets.

Authors

Institutions

Publication Details

Journal
Scientific Reports
Published
2025-11-11
DOI
https://doi.org/10.1038/s41598-025-23093-w
Citations
1
Primary Topic
Advanced Text Analysis Techniques
Type
article
Field-Weighted Citation Impact
2.48

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

An improved GPT2-based joint event extraction method with position expansion and knowledge augmentation

Christophe Roche, Yangli Jia, Zhenling Zhang, Μαρία Παπαδοπούλου et al.
1 citations
Scientific Reports
Advanced Text Analysis Techniques
2.48
article

An improved GPT2-based joint event extraction method with position expansion and knowledge augmentation

Christophe Roche, Yangli Jia, Zhenling Zhang, Μαρία Παπαδοπούλου, Trinh Hoai An, Ronghao Jia
article en
1 citations

Abstract

With the rapid development of the Internet and social media, massive amounts of unstructured data have emerged, making event extraction increasingly important for information retrieval. In the financial domain, challenges such as long texts, redundant content, and complex structures hinder extraction tasks. To address this, we propose PosEKE-GPT2, an improved GPT2-based model that reformulates event extraction as a text generation task. The model jointly identifies event types, triggers, and arguments using structured canonical text and a sub-task extraction strategy to reduce error propagation. An expanded positional encoding mechanism enhances event representation in long texts. Furthermore, we introduce a knowledge augmentation module that dynamically selects and integrates external knowledge via prompt mechanisms and attention-based embedding optimization. Experiments on the DuEE-Fin dataset show that PosEKE-GPT2 achieves an average F1-score of 90.61, while on the FewFC dataset it reaches an average F1-score of 88.85, both outperforming baseline models. Ablation studies verify the effectiveness of the positional encoding and knowledge augmentation modules, demonstrating the model's robustness and suitability for financial event extraction across different datasets.

Scientific ReportsVol. 15(1)
Liaocheng University (CN), Shanghai Shipbuilding Technology Research Institute (CN), China State Shipbuilding (China) (CN), Crete University Press (GR), Université Savoie Mont Blanc (FR)
National Natural Science Foundation of China, Liaocheng University
Openalex Percentile: Top 8%
Advanced Text Analysis Techniques
2.48
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

An improved GPT2-based joint event extraction method with position expansion and knowledge augmentation — Christophe Roche, Yangli Jia, et al. · Scientific Reports (2025) | TGRS Research Map | TGRS