F-LoRA-QA: Finetuning LLaMA Models with Low-Rank Adaptation for French Botanical Question Generation and Answering
Despite recent advances in large language models (LLMs), most question-answering (QA) systems remain English-centric and poorly suited to domain-specific scientific texts.This linguistic and domain bias poses a major challenge in botany, where a substantial portion of knowledge is documented in French.We introduce F-LoRA-QA, a fine-tuned LLaMA-based pipeline for French botanical QA, leveraging Low-Rank Adaptation (LoRA) for efficient domain adaptation.We construct a specialized dataset of 16,962 question-answer pairs extracted from scientific flora descriptions and fine-tune LLaMA models to retrieve structured knowledge from unstructured botanical texts.Expert-based evaluation confirms the linguistic quality and domain relevance of the generated responses.Compared to baseline LLaMA models, F-LoRA-QA achieves a four-fold improvement in BLEU, a 70% ROUGE-1 F1 gain, a 16.8% increase in BERTScore F1, and an Exact Match improvement from 2.01% to 23.57%.These results demonstrate the effectiveness of adapting LLMs to low-resource scientific domains and highlight the potential of our approach for automated trait extraction and biodiversity data structuring.
Authors
- Jihad Zahir (ORCID: https://orcid.org/0000-0002-5344-8277)
- Hajar Mousannif (ORCID: https://orcid.org/0000-0002-1307-4215)
- Régine Vignes‐Lebbe (ORCID: https://orcid.org/0000-0002-6912-6248)
- Ayoub Nainia
Institutions
- Cadi Ayyad University (MA)
- Institut de Systématique, Évolution, Biodiversité (FR)
- Unité de Modélisation Mathématique et Informatique des Systèmes Complexes (FR)
- Institut de Recherche pour le Développement (FR)
Publication Details
- Journal
- International conference Recent advances in natural language processing
- Published
- 2025-01-01
- DOI
- https://doi.org/10.26615/978-954-452-098-4-091
- Citations
- 1
- Primary Topic
- Natural Language Processing Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.89
Funders
- European Commission
- Agence Nationale de la Recherche
- HORIZON EUROPE Framework Programme