Multimodal Question Answering with DenseNet and BERT for Improved User Interaction

Visual Question Answering (VQA) is a challenging AI task that combines computer vision and natural language processing to generate contextual answers from image inputs. It requires a model that is capable of comprehending both visual and textual information, generating correct reasoning and context-based predictions. The proposed model uses DenseNet to capture deep visual features and BERT to process questions so that image-text correlation can be interpreted more judiciously. With the ability to handle complex images and different linguistic structures, this system is most appropriate for education, healthcare, security, and accessibility applications, in which automatic question answering based on images enhances decision-making and user participation.Existing approaches, such as machine learning-based question generation, attention model, and Faster R-CNN-based methods, have drawbacks like inconsistent responses, high computational overhead, and scalability. The introduced model addresses the feature extraction process, increases contextual alignment, and maximizes training efficiency with learning rate scheduling and mixed-precision training, and it is a more efficient and scalable method than the current techniques.

Authors

Institutions

Publication Details

Published
2025-05-09
DOI
https://doi.org/10.1109/stcr62650.2025.11019326
Citations
1
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
2.48
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Multimodal Question Answering with DenseNet and BERT for Improved User Interaction

Bharathi Mohan G, Chennu Chaitanya, Bandaru Bhavana
1 citations
Topic Modeling
2.48
article

Multimodal Question Answering with DenseNet and BERT for Improved User Interaction

Bharathi Mohan G, Chennu Chaitanya, Bandaru Bhavana
article en
1 citations

Abstract

Visual Question Answering (VQA) is a challenging AI task that combines computer vision and natural language processing to generate contextual answers from image inputs. It requires a model that is capable of comprehending both visual and textual information, generating correct reasoning and context-based predictions. The proposed model uses DenseNet to capture deep visual features and BERT to process questions so that image-text correlation can be interpreted more judiciously. With the ability to handle complex images and different linguistic structures, this system is most appropriate for education, healthcare, security, and accessibility applications, in which automatic question answering based on images enhances decision-making and user participation.Existing approaches, such as machine learning-based question generation, attention model, and Faster R-CNN-based methods, have drawbacks like inconsistent responses, high computational overhead, and scalability. The introduced model addresses the feature extraction process, increases contextual alignment, and maximizes training efficiency with learning rate scheduling and mixed-precision training, and it is a more efficient and scalable method than the current techniques.

Amrita Vishwa Vidyapeetham (IN)
Openalex Percentile: Top 10%
Topic Modeling
2.48
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.