Unified Information Extraction Method for Power Operation Inspection Based on ERNIE
Unified Information Extraction (UIE) has emerged as a critical task in Natural Language Processing. By employing a unified modeling approach, it enhances both the accuracy and generalizability of information extraction while addressing the issues of resource wastage and insufficient knowledge sharing in single-task model. However, existing UIE methods struggle to adapt to the power sector due to the unique characteristics of its textual data, including ambiguous entity boundaries and complex semantics. To this end, a UIE framework tailored for the power industry has been designed, introducing the Prompt-based ERNIE and Pointer Network for Unified Information Extraction (PENP-UIE) model. PENP-UIE effectively tackles low-resource challenges through a prompt-based methodology, employing the ERNIE 3.0 pre-trained language model in the encoding layer to accommodate the specific features of power texts, while the decoding layer utilizes pointer networks to address entity nesting issues. To facilitate effective domain-specific finetuning, a dataset encompassing equipment defect maintenance has been constructed, which includes eight core entity types relevant to the power sector, thereby aligning closely with real-world applications. Comparative experiments across nine named entity recognition tasks, five relation extraction tasks, two event extraction tasks, and five UIE methods demonstrate that PENP-UIE consistently outperforms existing models. This dataset has been publicly released, significantly contributing to the structuralization of textual data in the power domain.
Authors
- Zhuangzhuang Li (ORCID: https://orcid.org/0009-0005-6987-3648)
- M. Wang (ORCID: https://orcid.org/0009-0007-4919-7309)
- Yong Li (ORCID: https://orcid.org/0009-0002-3347-4993)
- Meng Liu (ORCID: https://orcid.org/0000-0002-3928-3373)
- Yi Yang (ORCID: https://orcid.org/0000-0002-8407-2700)
Institutions
- Beijing University of Posts and Telecommunications (CN)
Publication Details
- Published
- 2024-12-27
- DOI
- https://doi.org/10.1145/3718491.3718580
- Primary Topic
- Power Systems and Technologies
- Type
- article
- Field-Weighted Citation Impact
- 0.00