CXRG-SVLM: a parameter-efficient small vision-language model for multi-view chest X-ray report generation in resource-constrained environments

Abstract Automated chest X-ray report generation reduces reporting delays in resource-constrained clinical environments. Existing vision-language models often rely on large language models or full fine-tuning. This dependence causes high computational costs and limits on-premise deployment. We propose CXRG-SVLM. This small vision-language model combines a frozen RAD-DINO medical image encoder with a 4-bit quantized Qwen2.5-3B language model adapted using 4-bit QLoRA. A multi-view fusion module integrates frontal and lateral radiographs into a compact continuous visual representation. The resulting visual tokens are projected into the language-model embedding space and concatenated with clinical-indication embeddings to form a conditioning prefix. The decoder uses its native causal self-attention over this prefix and the generated tokens to produce the Findings report. The assembled implementation reports approximately 1.99 billion loaded parameter elements, of which approximately 38.1 million are trainable, corresponding to 1.91% of this framework-reported inventory. We evaluated the model on the Indiana University Chest X-ray dataset to generate the Findings section of the radiology report. The proposed model attains a ROUGE-L score of 0.3527 and a METEOR score of 0.2744. Automated entity-level agreement varies across findings, with the strongest F1 for normal descriptors and measurable agreement for pleural effusion, pneumothorax, and mediastinal mentions under the reported rule-based evaluation. Efficiency testing shows an average generation time of 5.27 seconds per report on a single graphics processing unit. These results establish the model’s computational feasibility and motivate subsequent radiologist evaluation of factual correctness, safety, and practical usefulness. Ultimately, CXRG-SVLM demonstrates that a parameter-efficient approach with less than 2% trainable parameters maintains competitive semantic fidelity, establishing an accessible foundation for future, prospectively validated on-premise clinical decision-support tools.

Authors

Institutions

Publication Details

Journal
Scientific Reports
Published
2026-10-29
DOI
https://doi.org/10.1038/s41598-026-77203-3
Primary Topic
Multimodal Machine Learning Applications
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

CXRG-SVLM: a parameter-efficient small vision-language model for multi-view chest X-ray report generation in resource-constrained environments

Jamal Uddin, Adeel Ahmed, Muhammad Awais Sattar, Abid Hussain Sayyid et al.
3 links
Scientific Reports
Multimodal Machine Learning Applications
article

CXRG-SVLM: a parameter-efficient small vision-language model for multi-view chest X-ray report generation in resource-constrained environments

Jamal Uddin, Adeel Ahmed, Muhammad Awais Sattar, Abid Hussain Sayyid, Muhammad Fareed
article en

Abstract

Abstract Automated chest X-ray report generation reduces reporting delays in resource-constrained clinical environments. Existing vision-language models often rely on large language models or full fine-tuning. This dependence causes high computational costs and limits on-premise deployment. We propose CXRG-SVLM. This small vision-language model combines a frozen RAD-DINO medical image encoder with a 4-bit quantized Qwen2.5-3B language model adapted using 4-bit QLoRA. A multi-view fusion module integrates frontal and lateral radiographs into a compact continuous visual representation. The resulting visual tokens are projected into the language-model embedding space and concatenated with clinical-indication embeddings to form a conditioning prefix. The decoder uses its native causal self-attention over this prefix and the generated tokens to produce the Findings report. The assembled implementation reports approximately 1.99 billion loaded parameter elements, of which approximately 38.1 million are trainable, corresponding to 1.91% of this framework-reported inventory. We evaluated the model on the Indiana University Chest X-ray dataset to generate the Findings section of the radiology report. The proposed model attains a ROUGE-L score of 0.3527 and a METEOR score of 0.2744. Automated entity-level agreement varies across findings, with the strongest F1 for normal descriptors and measurable agreement for pleural effusion, pneumothorax, and mediastinal mentions under the reported rule-based evaluation. Efficiency testing shows an average generation time of 5.27 seconds per report on a single graphics processing unit. These results establish the model’s computational feasibility and motivate subsequent radiologist evaluation of factual correctness, safety, and practical usefulness. Ultimately, CXRG-SVLM demonstrates that a parameter-efficient approach with less than 2% trainable parameters maintains competitive semantic fidelity, establishing an accessible foundation for future, prospectively validated on-premise clinical decision-support tools.

Scientific Reports
Luleå University of Technology (SE), Riphah International University (PK)
Riphah International University
Openalex Percentile: Top 17%
Multimodal Machine Learning Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon