Bridging the Medical Knowledge Gap: Investigating the Efficacy of 4-bit Instruction-Tuning on Llama-3-8B for Clinical Reasoning
This work investigates the effectiveness of 4-bit quantization and parameter-efficient fine-tuning (QLoRA) applied to the Llama-3-8B language model for clinical biomedical reasoning tasks. The study demonstrates that expert-level reasoning performance can be achieved on consumer-grade hardware by carefully balancing quantization precision, adapter configuration, and domain-specific instruction tuning. Results highlight the trade-offs between memory efficiency, accuracy, and deployability, supporting broader access to advanced medical AI systems under strict computational constraints.
Authors
- Aditya Verma
Publication Details
- Journal
- Zenodo (CERN European Organization for Nuclear Research)
- Published
- 2026-02-09
- DOI
- https://doi.org/10.5281/zenodo.18547419
- Primary Topic
- Ferroelectric and Negative Capacitance Devices
- Type
- article
- Field-Weighted Citation Impact
- 0.00