Scientist attribute extraction based on instruction supervised fine-tuning and loss function redefinition

The challenge of obtaining high-quality labeled data for scientist attributes significantly impacts traditional deep learning models in the task of scientist attribute extraction. These models typically depend heavily on extensive labeled datasets to achieve optimal performance. However, due to the limited availability of such high-quality labeled data, these models often exhibit weaker generalization abilities when applied to new, unseen data. Utilizing large language models, which possess stronger text comprehension abilities, for scientist attribute extraction can effectively reduce dependence on labeled data. However, the issue of "hallucination" in large language models affects their performance in this task. To address this issue, this paper firstly constructs an ontology for scientist attributes and designs prompt strategies. Subsequently, the idea of bounding box regression loss from object detection tasks is adopted to redefine the loss function for Fine-Tuning large models. This redefinition ensures a clear convergence direction when applying large models to scientist attribute extraction task, effectively reducing LLM hallucination and enhancing the accuracy of the attribute identification process. Our empirical evaluation demonstrates that this novel methodology substantially enhances the efficacy of large models in scientist attribute extraction task.

Authors

Institutions

Publication Details

Published
2025-07-24
DOI
https://doi.org/10.1117/12.3068455
Primary Topic
Advanced Computational Techniques and Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Scientist attribute extraction based on instruction supervised fine-tuning and loss function redefinition

Xiulei Liu, Linghui Wang, Xuhong Liu, Jie Liu et al.
Advanced Computational Techniques and Applications
article

Scientist attribute extraction based on instruction supervised fine-tuning and loss function redefinition

Xiulei Liu, Linghui Wang, Xuhong Liu, Jie Liu, Ning Li
article en

Abstract

The challenge of obtaining high-quality labeled data for scientist attributes significantly impacts traditional deep learning models in the task of scientist attribute extraction. These models typically depend heavily on extensive labeled datasets to achieve optimal performance. However, due to the limited availability of such high-quality labeled data, these models often exhibit weaker generalization abilities when applied to new, unseen data. Utilizing large language models, which possess stronger text comprehension abilities, for scientist attribute extraction can effectively reduce dependence on labeled data. However, the issue of "hallucination" in large language models affects their performance in this task. To address this issue, this paper firstly constructs an ontology for scientist attributes and designs prompt strategies. Subsequently, the idea of bounding box regression loss from object detection tasks is adopted to redefine the loss function for Fine-Tuning large models. This redefinition ensures a clear convergence direction when applying large models to scientist attribute extraction task, effectively reducing LLM hallucination and enhancing the accuracy of the attribute identification process. Our empirical evaluation demonstrates that this novel methodology substantially enhances the efficacy of large models in scientist attribute extraction task.

Beijing Information Science & Technology University (CN)
Openalex Percentile: Top 91%
Advanced Computational Techniques and Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Scientist attribute extraction based on instruction supervised fine-tuning and loss function redefinition — Xiulei Liu, Linghui Wang, et al. · (2025) | TGRS Research Map | TGRS