Few-shot Biomedical NER via Multi-task Learning and More Fine-grained Grid-tagging Strategy
Biomedical Named Entity Recognition (NER) serves as a crucial task in biomedical information extraction, aiming to identify and classify entities from unstructured biomedical texts. However, obtaining high-quality annotated biomedical texts is scarce due to their high privacy and the specialized expertise required. Therefore, more researchers are focusing on few-shot NER in the biomedical field. Recent methods mainly fall into three categories: 1) transferring knowledge from high-resource data and fine-tuning with low-resource data, 2) modifying data using various methods to generate new samples, and 3) decompose the NER task into two subtasks with multi-task learning. However, these methods either suffer from domain shift, generate low-quality synthetic data, or encounter error propagation issues. To address these limitations, we have investigated an few-shot NER method, which firstly employs specific prompt templates to guide Large Language Models in generating high-quality new samples. Then, we propose a novel more fine-grained grid-tagging strategy and single-end sensitive multi-task learning framework. This method sets multiple losses to enable the model to learn from multiple task objectives: what constitutes a fully correct, partially correct, and incorrect entity. Additionally, through the new grid-tagging strategy, the model can decode entities based on more tagging clues. To better align with real-world scenarios, we trained in a few-shot scenario and evaluated on the full test set. Extensive experimental results on the NCBI, BC5CDR, BioNLP11EPI, and BioNLP13GE datasets confirm that our method outperforms previous state-of-the-art methods in most scenarios. <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">1</sup>
Authors
- Di Zhao (ORCID: https://orcid.org/0000-0002-0876-5126)
- Shuang Liu (ORCID: https://orcid.org/0000-0003-0101-9486)
- Wenxuan Mu
- Hongfei Lin
- Jiana Meng (ORCID: https://orcid.org/0000-0002-7220-5748)
Institutions
- Dalian University of Technology (CN)
- Dalian Minzu University (CN)
Publication Details
- Published
- 2024-12-03
- DOI
- https://doi.org/10.1109/bibm62325.2024.10822273
- Citations
- 1
- Primary Topic
- Medical Imaging Techniques and Applications
- Type
- article
- Field-Weighted Citation Impact
- 0.40
Funders
- Natural Science Foundation of Liaoning Province
- Fundamental Research Funds for the Central Universities