Modular Approaches to Complex Reasoning in Visual Question Answering Systems
Visual Question Answering is a challenging task requiring the integration of visual and textual information to answer questions about images. This research introduces a robust VQA system that combines advanced deep learning techniques, including Visual BERT, ViLT, cross-modal memory networks, memory-augmented attention mechanisms, and vision language pre-training models such as Flamingo and BLIP. These methods enable effective multimodal fusion, dynamic memory retrieval, and adaptation to novel question types using few-shot learning. Using the VQA v2.0 dataset, the system achieved 80% accuracy, outperforming traditional models such as LSTM-CNN and attention-only approaches. Enhanced BLEU scores and precision-recall metrics underscore its capability in handling complex, multi-step reasoning tasks. This work highlights significant improvements in VQA systems and establishes a scalable framework for advancing multimodal learning, paving the way for future research on larger datasets and real-world applications.
Authors
- Sandeep Dwarkanath Pande (ORCID: https://orcid.org/0000-0001-6969-0423)
- Sagar Rohidas Chavan (ORCID: https://orcid.org/0000-0002-2844-9905)
- Akshay Bhosale (ORCID: https://orcid.org/0000-0003-2141-3691)
- Sujit Wandre
- Ketan Waje
Institutions
- MIT Art, Design and Technology University (IN)
- MIT Academy of Engineering
Publication Details
- Published
- 2025-02-27
- DOI
- https://doi.org/10.1109/isacc65211.2025.10969384
- Primary Topic
- Constraint Satisfaction and Optimization
- Type
- article
- Field-Weighted Citation Impact
- 0.00