Fine-tuned large language models into traditional back-end web architectures
<p>Integrating Large Language Models (LLMs) into traditional back-end systems can significantly reduce development overhead and enhance flexibility. This paper presents a novel approach using a fine-tuned LLama3 model as a modular back-end component capable of processing JSON-formatted inputs and outputs. We developed a specialized dataset through advanced prompt engineering with the Phi-3.5 model and fine-tuned LLama3 using Quantized Low-Rank Adaptation (QLoRA) on a single NVIDIA T4 GPU. An API layer was designed to facilitate seamless communication between clients and the LLM, effectively replacing conventional application logic. Our fine-tuned model achieved an average accuracy of 76.5¥% and a response time of 3.56 s across 100 test cases, demonstrating its effectiveness in handling back-end tasks. This work underscores the potential of LLMs to transform AI-driven back-end architectures, offering scalable and efficient solutions for modern web services. <strong></strong></p>
Authors
- Chuan Zhang (ORCID: https://orcid.org/0000-0003-4736-1658)
- Bowen Li (ORCID: https://orcid.org/0009-0006-9380-9539)
Institutions
- RMIT Europe (ES)
Publication Details
- Journal
- Computer and Telecommunication Engineering
- Published
- 2025-03-19
- DOI
- https://doi.org/10.54517/cte3168
- Primary Topic
- Distributed and Parallel Computing Systems
- Type
- article
- Field-Weighted Citation Impact
- 0.00