A Multimodal AI Framework for Medical Education: Integrating Adaptive Image Retrieval, Fast Synthesis, and LLM-Based Clinical Auditing
Access to reliable medical images is essential for clinical training. To address this need, this paper presents an extended version of MIRAGE, a multimodal retrieval and generation system that utilizes a shared latent space to process medical queries by retrieving real images from the ROCO dataset, generating synthetic scans, and providing LLM-based clinical descriptions alongside dual-concept visual comparisons. To overcome previous computational limits and the lack of clinical validation, we introduce three core enhancements: first, an Auto-α module to dynamically weight visual and textual similarities; second, the integration of LCM-LoRA to accelerate synthetic image generation; and third, an automated clinical auditor based on Gemini 2.5 Flash. Experimental results demonstrate that Auto-α improves retrieval accuracy for heterogeneous queries, reaching 38.83% Top-1 Recall over a 65,419-image gallery and outperforming nine fusion baselines evaluated under a unified configuration, with a controlled ablation attributing most of this gain to learning the weight rather than merely making it query-adaptive, while the LCM-LoRA module reduces computational costs by a factor of 12.5× in CPU environments, with a blinded radiologist evaluation confirming only a small drop in clinical quality. Furthermore, the clinical auditor achieves a 0.805 Pearson correlation against an expert radiologist, effectively correcting the systematic overestimation of traditional CLIP scores. Finally, the optimized platform is publicly deployed on Hugging Face.
Authors
- Álvaro García‐Martín (ORCID: https://orcid.org/0000-0002-1705-3972)
- Jesús Bescós (ORCID: https://orcid.org/0000-0001-6238-6859)
- Cecilia Diana-Albelda (ORCID: https://orcid.org/0009-0009-9210-0853)
- Mario Rubén Paz Campos (ORCID: https://orcid.org/0009-0007-4964-5626)
- Miguel Díaz-Benito (ORCID: https://orcid.org/0009-0002-2110-9972)
Institutions
- Hospital Universitario de La Princesa (ES)
- Universidad Carlos III de Madrid (ES)
- Universidad Autónoma de Madrid (ES)
Publication Details
- Journal
- Journal of Imaging
- Published
- 2026-09-11
- DOI
- https://doi.org/10.3390/jimaging12090438
- Primary Topic
- Multimodal Machine Learning Applications
- Type
- article
- Field-Weighted Citation Impact
- 0.00