Few-shot Biomedical NER via Multi-task Learning and More Fine-grained Grid-tagging Strategy

Biomedical Named Entity Recognition (NER) serves as a crucial task in biomedical information extraction, aiming to identify and classify entities from unstructured biomedical texts. However, obtaining high-quality annotated biomedical texts is scarce due to their high privacy and the specialized expertise required. Therefore, more researchers are focusing on few-shot NER in the biomedical field. Recent methods mainly fall into three categories: 1) transferring knowledge from high-resource data and fine-tuning with low-resource data, 2) modifying data using various methods to generate new samples, and 3) decompose the NER task into two subtasks with multi-task learning. However, these methods either suffer from domain shift, generate low-quality synthetic data, or encounter error propagation issues. To address these limitations, we have investigated an few-shot NER method, which firstly employs specific prompt templates to guide Large Language Models in generating high-quality new samples. Then, we propose a novel more fine-grained grid-tagging strategy and single-end sensitive multi-task learning framework. This method sets multiple losses to enable the model to learn from multiple task objectives: what constitutes a fully correct, partially correct, and incorrect entity. Additionally, through the new grid-tagging strategy, the model can decode entities based on more tagging clues. To better align with real-world scenarios, we trained in a few-shot scenario and evaluated on the full test set. Extensive experimental results on the NCBI, BC5CDR, BioNLP11EPI, and BioNLP13GE datasets confirm that our method outperforms previous state-of-the-art methods in most scenarios. <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">1</sup>

Authors

Institutions

Publication Details

Published
2024-12-03
DOI
https://doi.org/10.1109/bibm62325.2024.10822273
Citations
1
Primary Topic
Medical Imaging Techniques and Applications
Type
article
Field-Weighted Citation Impact
0.40

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Few-shot Biomedical NER via Multi-task Learning and More Fine-grained Grid-tagging Strategy

Di Zhao, Shuang Liu, Wenxuan Mu, Hongfei Lin et al.
1 citations
Medical Imaging Techniques and Applications
0.40
article

Few-shot Biomedical NER via Multi-task Learning and More Fine-grained Grid-tagging Strategy

Di Zhao, Shuang Liu, Wenxuan Mu, Hongfei Lin, Jiana Meng
article en
1 citations

Abstract

Biomedical Named Entity Recognition (NER) serves as a crucial task in biomedical information extraction, aiming to identify and classify entities from unstructured biomedical texts. However, obtaining high-quality annotated biomedical texts is scarce due to their high privacy and the specialized expertise required. Therefore, more researchers are focusing on few-shot NER in the biomedical field. Recent methods mainly fall into three categories: 1) transferring knowledge from high-resource data and fine-tuning with low-resource data, 2) modifying data using various methods to generate new samples, and 3) decompose the NER task into two subtasks with multi-task learning. However, these methods either suffer from domain shift, generate low-quality synthetic data, or encounter error propagation issues. To address these limitations, we have investigated an few-shot NER method, which firstly employs specific prompt templates to guide Large Language Models in generating high-quality new samples. Then, we propose a novel more fine-grained grid-tagging strategy and single-end sensitive multi-task learning framework. This method sets multiple losses to enable the model to learn from multiple task objectives: what constitutes a fully correct, partially correct, and incorrect entity. Additionally, through the new grid-tagging strategy, the model can decode entities based on more tagging clues. To better align with real-world scenarios, we trained in a few-shot scenario and evaluated on the full test set. Extensive experimental results on the NCBI, BC5CDR, BioNLP11EPI, and BioNLP13GE datasets confirm that our method outperforms previous state-of-the-art methods in most scenarios. <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">1</sup>

Dalian University of Technology (CN), Dalian Minzu University (CN)
Natural Science Foundation of Liaoning Province, Fundamental Research Funds for the Central Universities
Openalex Percentile: Top 31%
Medical Imaging Techniques and Applications
0.40
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.