Question-Enhanced for Semantic Representation in Fine-Tuning Pre-Trained Encoding Models for Chinese Event Argument Extraction
Event argument extraction is a crucial task in natural language processing, aimed at extracting structured information from unstructured textual data. In response to the challenges posed by limited resources, this study proposes a fine-tuning method for question-answering tasks based on a question-enhanced mechanism in pre-trained models. In practical scenarios where annotated data is scarce, this method demonstrates unique advantages through transfer learning of event types. By pre-training encoding using question templates, the method expands the feature representation of question-answer texts, exhibiting better performance when multiple roles are mentioned in events and these roles belong to the same entity type. Additionally, the method offers effective strategies for handling default arguments that may occur in events. The proposed model not only enhances the recognition and understanding of complex event structures but also improves performance under data scarcity conditions.
Authors
- Yulong Liang (ORCID: https://orcid.org/0009-0000-1130-1712)
- Xiaolei Zhou (ORCID: https://orcid.org/0000-0002-1562-1390)
- Huajun Sun (ORCID: https://orcid.org/0000-0003-1898-088X)
- Ruifeng Guo (ORCID: https://orcid.org/0000-0003-3345-0502)
Institutions
- Shenyang Institute of Computing Technology (China) (CN)
- University of Chinese Academy of Sciences (CN)
Publication Details
- Published
- 2024-12-13
- DOI
- https://doi.org/10.1109/iccc62609.2024.10942285
- Primary Topic
- Natural Language Processing Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.00