LoRA-based Domain Adaptation of Qwen-7B for Veterinary and Livestock Text Generation: A Lexical and Semantic Evaluation of Base and Fine-Tuned Outputs

Large language models (LLMs) have demonstrated strong capabilities in natural language processing; however, their effectiveness in specialized domains depends on their ability to represent domain-specific terminology, conceptual relations, and contextual knowledge. This study evaluates the effect of Low-Rank Adaptation (LoRA)-based domain adaptation on the text-generation behavior of Qwen-7B in veterinary and livestock sciences. The base Qwen-7B causal language model was adapted using a domain-specific corpus compiled from veterinary and livestock literature. The adaptation process was conducted within an instructionformatted causal language modeling framework, in which unlabeled domain texts were transformed into structured prompt–response representations. The base and LoRA-adapted models were evaluated on an independent 100-question domain-specific test set using a multidimensional protocol that combined lexical overlap metrics, Bilingual Evaluation Understudy (BLEU), Recall-Oriented Understudy for Gisting Evaluation (ROUGE), and Metric for Evaluation of Translation with Explicit ORdering (METEOR), with the semantic similarity metric Bidirectional Encoder Representations from Transformers Score (BERTScore).. The results showed that LoRA-based adaptation did not produce uniform improvement across all evaluation dimensions. Instead, the adapted model showed higher BERTScore-based semantic similarity while exhibiting reduced surface-level lexical overlap. Therefore, the observed effect should be interpreted as a metric-dependent reorientation of model output rather than as a general performance gain. Overall, this study provides descriptive evidence that parameter-efficient fine-tuning can modify the generation behavior of LLMs in veterinary and livestock text-generation tasks, while also highlighting the need for multidimensionally supported, contamination controlled, and expert-informed evaluation before such models can be considered reliable for clinical or decision support applications.

Authors

Institutions

Publication Details

Journal
Istanbul University - Journal of Electrical & Electronics Engineering
Published
2026-10-27
DOI
https://doi.org/10.5152/electrica.2026.26160
Primary Topic
Domain Adaptation and Few-Shot Learning
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

LoRA-based Domain Adaptation of Qwen-7B for Veterinary and Livestock Text Generation: A Lexical and Semantic Evaluation of Base and Fine-Tuned Outputs

Mehmet Erman Or, Mehmet Erkan Yüksel, Ömür Koçak, Selçuk Sevgen et al.
2 links
Istanbul University - Journal of Electrical & Electronics Engineering
Domain Adaptation and Few-Shot Learning
article

LoRA-based Domain Adaptation of Qwen-7B for Veterinary and Livestock Text Generation: A Lexical and Semantic Evaluation of Base and Fine-Tuned Outputs

Mehmet Erman Or, Mehmet Erkan Yüksel, Ömür Koçak, Selçuk Sevgen, Tolgahan Öztürk
article en

Abstract

Large language models (LLMs) have demonstrated strong capabilities in natural language processing; however, their effectiveness in specialized domains depends on their ability to represent domain-specific terminology, conceptual relations, and contextual knowledge. This study evaluates the effect of Low-Rank Adaptation (LoRA)-based domain adaptation on the text-generation behavior of Qwen-7B in veterinary and livestock sciences. The base Qwen-7B causal language model was adapted using a domain-specific corpus compiled from veterinary and livestock literature. The adaptation process was conducted within an instructionformatted causal language modeling framework, in which unlabeled domain texts were transformed into structured prompt–response representations. The base and LoRA-adapted models were evaluated on an independent 100-question domain-specific test set using a multidimensional protocol that combined lexical overlap metrics, Bilingual Evaluation Understudy (BLEU), Recall-Oriented Understudy for Gisting Evaluation (ROUGE), and Metric for Evaluation of Translation with Explicit ORdering (METEOR), with the semantic similarity metric Bidirectional Encoder Representations from Transformers Score (BERTScore).. The results showed that LoRA-based adaptation did not produce uniform improvement across all evaluation dimensions. Instead, the adapted model showed higher BERTScore-based semantic similarity while exhibiting reduced surface-level lexical overlap. Therefore, the observed effect should be interpreted as a metric-dependent reorientation of model output rather than as a general performance gain. Overall, this study provides descriptive evidence that parameter-efficient fine-tuning can modify the generation behavior of LLMs in veterinary and livestock text-generation tasks, while also highlighting the need for multidimensionally supported, contamination controlled, and expert-informed evaluation before such models can be considered reliable for clinical or decision support applications.

Istanbul University - Journal of Electrical & Electronics EngineeringVol. 26
Istanbul University-Cerrahpaşa (TR), Istanbul University (TR)
Openalex Percentile: Top 14%
Domain Adaptation and Few-Shot Learning
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon