Few-shot biomedical NER empowered by LLMs-assisted data augmentation and multi-scale feature extraction
Named Entity Recognition (NER) is a fundamental task in processing biomedical text. Due to the limited availability of labeled data, researchers have investigated few-shot learning methods to tackle this challenge. However, replicating the performance of fully supervised methods remains difficult in few-shot scenarios. This paper addresses two main issues. In terms of data augmentation, existing methods primarily focus on replacing content in the original text, which can potentially distort the semantics. Furthermore, current approaches often neglect sentence features at multiple scales. To overcome these challenges, we utilize ChatGPT to generate enriched data with distinct semantics for the same entities, thereby reducing noisy data. Simultaneously, we employ dynamic convolution to capture multi-scale semantic information in sentences and enhance feature representation based on PubMedBERT. We evaluated the experiments on four biomedical NER datasets (BC5CDR-Disease, NCBI, BioNLP11EPI, BioNLP13GE), and the results exceeded the current state-of-the-art models in most few-shot scenarios, including mainstream large language models like ChatGPT. The results confirm the effectiveness of the proposed method in data augmentation and model generalization.
Authors
- Yonghe Chu (ORCID: https://orcid.org/0000-0002-2140-5694)
- Di Zhao (ORCID: https://orcid.org/0000-0002-0876-5126)
- Wenxuan Mu
- Shuang Liu (ORCID: https://orcid.org/0000-0003-2097-9108)
- Jiana Meng (ORCID: https://orcid.org/0000-0002-7220-5748)
- Xiangxing Jia
- Hongfei Lin
Institutions
- Nantong University (CN)
- Dalian University of Technology (CN)
- Dalian Minzu University (CN)
Publication Details
- Journal
- BioData Mining
- Published
- 2025-04-04
- DOI
- https://doi.org/10.1186/s13040-025-00443-y
- Citations
- 5
- Primary Topic
- Topic Modeling
- Type
- article
- Field-Weighted Citation Impact
- 12.40
Funders
- Natural Science Foundation of Liaoning Province
- Fundamental Research Funds for the Central Universities