Stack-Based Ensembles for Robust Neural Image Captioning

This paper considers a stack-based ensemble approach to image captioning which will augment the textual description generation task from visual input in an accurate and contextually relevant manner. Diverse architectures such as Convolutional Neural Networks coupled with LSTM networks and models of Transformer, along with Graph Neural Networks, give leeway over the limitations of single-model approaches that have been standing against managing the complex visual data. Results obtained on established datasets like MS COCO, Flickr30k, and Flickr8k illustrate the benefit of ensemble over single models, resulting in the BLEU-4 score of 0.67, METEOR score of 0.34, and CIDEr of 1.20. This research impacts not only applications but also life: from real-time social media captioning, creation of personalized content, up to accessibility solutions. This work, therefore, puts emphasis on the vast potential of ensemble learning regarding advancing image captioning technologies and, hence, locates it as a promising area for future exploration in both digital media and assistive technologies.

Authors

Publication Details

Published
2024-11-21
DOI
https://doi.org/10.1109/delcon64804.2024.10866694
Primary Topic
Multimodal Machine Learning Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Stack-Based Ensembles for Robust Neural Image Captioning

Uday Kiran G, V. Srilakshmi, Katakam Ashritha, B. Priyanka et al.
Multimodal Machine Learning Applications
article

Stack-Based Ensembles for Robust Neural Image Captioning

Uday Kiran G, V. Srilakshmi, Katakam Ashritha, B. Priyanka, B. Dhanasai, K. Smarandas
article en

Abstract

This paper considers a stack-based ensemble approach to image captioning which will augment the textual description generation task from visual input in an accurate and contextually relevant manner. Diverse architectures such as Convolutional Neural Networks coupled with LSTM networks and models of Transformer, along with Graph Neural Networks, give leeway over the limitations of single-model approaches that have been standing against managing the complex visual data. Results obtained on established datasets like MS COCO, Flickr30k, and Flickr8k illustrate the benefit of ensemble over single models, resulting in the BLEU-4 score of 0.67, METEOR score of 0.34, and CIDEr of 1.20. This research impacts not only applications but also life: from real-time social media captioning, creation of personalized content, up to accessibility solutions. This work, therefore, puts emphasis on the vast potential of ensemble learning regarding advancing image captioning technologies and, hence, locates it as a promising area for future exploration in both digital media and assistive technologies.

Openalex Percentile: Top 73%
Multimodal Machine Learning Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Stack-Based Ensembles for Robust Neural Image Captioning — Uday Kiran G, V. Srilakshmi, et al. · (2024) | TGRS Research Map | TGRS