An Algorithm for Automatic Generation of Tags for Children’s Health Science Resources Based on Instruction-Tuned LLM and Similarity Retrieval
In this paper, the research goal is to realize the automatic generation of children’s health science resources, in order to solve the two problems of inaccurate generation of resource labels in the field and the difficulties in standardization of label generation using Large Language Model (LLM). This paper proposes an automatic label generation algorithm for children s health science resources based on instructed LLM and vector (or word embedding) similarity retrieval. The algorithm first performs command fine-tuning of pre-trained LLM based on children s health science resources and LoRA (Low-Rank Adaptation) technology. Chroma vector database is then used to vectorize the standardized labels. Finally, the label results of instructed LLM are similarly matched with the vectorized standardized labels to generate the standardized label results. This paper verifies the effectiveness of the algorithm through three sets of comparative experiments based on the original data of 10,000 children’s health science resources. The experimental results show that the automatic generation ability of children s health science resources labels has been improved after domain data fine-tuning LLM and similarity retrieval.
Authors
- Xuemei Hu (ORCID: https://orcid.org/0000-0001-9009-0983)
- Yong Wang (ORCID: https://orcid.org/0000-0003-3366-3137)
- Min Jia (ORCID: https://orcid.org/0000-0002-4437-9812)
- Lin Ji (ORCID: https://orcid.org/0000-0002-7911-5446)
Institutions
- Palo Alto University (US)
- Middlebury College (US)
- Shanghai University of Traditional Chinese Medicine (CN)
- Stanford University (US)
Publication Details
- Published
- 2024-12-03
- DOI
- https://doi.org/10.1109/bibm62325.2024.10822325
- Citations
- 2
- Primary Topic
- Diverse Approaches in Healthcare and Education Studies
- Type
- article
- Field-Weighted Citation Impact
- 1.09