VisionAid GPT: A Multimodal Chest X-Ray Analysis Assistant Integrating Vision Transformers, Report Generation, and Retrieval-Augmented Question Answering
This work presents VisionAid GPT, a multimodal artificial intelligence system for chest X-ray analysis. The framework integrates Vision Transformer-based image classification, automated report generation, retrieval-augmented question answering, and an interactive user interface. The proposed system was evaluated using the Chest X-Ray Pneumonia dataset and achieved competitive classification performance while providing explainable outputs and conversational interaction capabilities. The project demonstrates the feasibility of combining modern transformer architectures with retrieval-augmented generation for healthcare-focused AI assistants.
Authors
- Emmanuel Ogenahotse Yerimah (ORCID: https://orcid.org/0009-0008-1076-1344)
Institutions
- University of Benin (NG)
Publication Details
- Journal
- Zenodo (CERN European Organization for Nuclear Research)
- Published
- 2026-06-16
- DOI
- https://doi.org/10.5281/zenodo.20713316
- Primary Topic
- COVID-19 diagnosis using AI
- Type
- article
- Field-Weighted Citation Impact
- 0.00