IMPLEMENTASI ALGORITMA CONVOLUTIONAL NEURAL NETWORK (CNN) PADA EVALUASI STRATEGI PROMPT ENGINEERING TERHADAP AKURASI VISUAL QUESTION ANSWERING (VQA)

Visual Question Answering (VQA) is the task of answering natural language questions about the content of an image. This study aims to identify the prompt engineering strategy with the highest VQA accuracy and to test whether the accuracy differs significantly among strategies. The model is a CNN–Transformer architecture with ResNet-50 as the visual encoder, BERT as the text encoder, and a cross-attention fusion layer. Five strategies were evaluated: zero-shot, few-shot, chain-of-thought, instruction-based, and role-prompting. The data consist of 8,000 questions from the VQA v2.0 validation set selected by stratified random sampling. Each strategy was trained with five random seeds and evaluated using VQA Accuracy and One-Way ANOVA. The results show that the instruction-based strategy achieved the highest mean accuracy of 37.54%, while the other strategies ranged from 36.63% to 37.17%. However, the differences were not statistically significant (p = 0.2897). The instruction-based strategy was then implemented in a web application prototype.

Authors

Institutions

Publication Details

Journal
Jurnal Riset Multidisiplin Edukasi
Published
2026-11-17
DOI
https://doi.org/10.71282/jurmie.v3i11.2726
Primary Topic
Multimodal Machine Learning Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

IMPLEMENTASI ALGORITMA CONVOLUTIONAL NEURAL NETWORK (CNN) PADA EVALUASI STRATEGI PROMPT ENGINEERING TERHADAP AKURASI VISUAL QUESTION ANSWERING (VQA)

Khairuddin Nasution, Darjat Saripurna, Muhammad Riyan
Jurnal Riset Multidisiplin Edukasi
Multimodal Machine Learning Applications
article

IMPLEMENTASI ALGORITMA CONVOLUTIONAL NEURAL NETWORK (CNN) PADA EVALUASI STRATEGI PROMPT ENGINEERING TERHADAP AKURASI VISUAL QUESTION ANSWERING (VQA)

Khairuddin Nasution, Darjat Saripurna, Muhammad Riyan
article en

Abstract

Visual Question Answering (VQA) is the task of answering natural language questions about the content of an image. This study aims to identify the prompt engineering strategy with the highest VQA accuracy and to test whether the accuracy differs significantly among strategies. The model is a CNN–Transformer architecture with ResNet-50 as the visual encoder, BERT as the text encoder, and a cross-attention fusion layer. Five strategies were evaluated: zero-shot, few-shot, chain-of-thought, instruction-based, and role-prompting. The data consist of 8,000 questions from the VQA v2.0 validation set selected by stratified random sampling. Each strategy was trained with five random seeds and evaluated using VQA Accuracy and One-Way ANOVA. The results show that the instruction-based strategy achieved the highest mean accuracy of 37.54%, while the other strategies ranged from 36.63% to 37.17%. However, the differences were not statistically significant (p = 0.2897). The instruction-based strategy was then implemented in a web application prototype.

Jurnal Riset Multidisiplin Edukasi
North Sumatra Islamic University (ID)
Multimodal Machine Learning Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon