SwahiliVQA: A Dataset for Visual Question Answering in Swahili Language

This paper introduces the first Swahili Visual Question Answering (SwahiliVQA) dataset, addressing the critical underrepresentation of African languages in vision-language research. Swahili, spoken by over 100 million people across East Africa, remains severely underserved in AI development despite its widespread use. Our dataset comprises 10,000 images paired with 41,448 question-answer combinations, translated from English resources and validated by native Swahili speakers to ensure linguistic authenticity. We establish baseline performance metrics using various model architectures and propose a novel multimodal approach that combines CLIP's vision encoder with a Swahili-specific RoBERTa model, achieving 38.38% accuracy. This work provides essential resources for Swahili-language AI development, establishes a methodological framework for creating VQA datasets in other underrepresented languages, and contributes to more equitable artificial intelligence that serves diverse linguistic communities across East Africa and beyond.

Authors

Institutions

Publication Details

Published
2025-08-14
DOI
https://doi.org/10.1109/mapr67746.2025.11133766
Primary Topic
Multimodal Machine Learning Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

SwahiliVQA: A Dataset for Visual Question Answering in Swahili Language

D. Hoang, Francis Stephen MBWANA
Multimodal Machine Learning Applications
article

SwahiliVQA: A Dataset for Visual Question Answering in Swahili Language

D. Hoang, Francis Stephen MBWANA
article en

Abstract

This paper introduces the first Swahili Visual Question Answering (SwahiliVQA) dataset, addressing the critical underrepresentation of African languages in vision-language research. Swahili, spoken by over 100 million people across East Africa, remains severely underserved in AI development despite its widespread use. Our dataset comprises 10,000 images paired with 41,448 question-answer combinations, translated from English resources and validated by native Swahili speakers to ensure linguistic authenticity. We establish baseline performance metrics using various model architectures and propose a novel multimodal approach that combines CLIP's vision encoder with a Swahili-specific RoBERTa model, achieving 38.38% accuracy. This work provides essential resources for Swahili-language AI development, establishes a methodological framework for creating VQA datasets in other underrepresented languages, and contributes to more equitable artificial intelligence that serves diverse linguistic communities across East Africa and beyond.

Vietnam Posts and Telecommunications Group (Vietnam) (VN), Posts and Telecommunications Institute of Technology
Quality Education
Openalex Percentile: Top 78%
Multimodal Machine Learning Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.