When Better Eyes Lead to Blindness: A Diagnostic Study of the Information Bottleneck in CNN-LSTM Image Captioning Models

Image captioning, situated at the intersection of computer vision and natural language processing, requires a sophisticated understanding of both visual scenes and linguistic structure.While modern approaches are dominated by large-scale Transformer architectures, this paper documents a systematic, iterative development of foundational image captioning models, progressing from a simple CNN-LSTM encoder-decoder to a competitive attention-based system.This paper presents a series of five models, beginning with Genesis and concluding with Nexus, an advanced model featuring an EfficientNetV2B3 backbone and a dynamic attention mechanism.The experiments chart the impact of architectural enhancements and demonstrate a key finding within the classic CNN-LSTM paradigm: merely upgrading the visual backbone without a corresponding attention mechanism can degrade performance, as the single-vector bottleneck cannot transmit the richer visual detail.This insight validates the architectural shift to attention.Trained on the MS COCO 2017 dataset, the final model, Nexus, achieves a BLEU-4 score of 31.4,surpassing several foundational benchmarks and validating the iterative design process.This work provides a clear, replicable blueprint for understanding the core architectural principles that underpin modern vision-language tasks.

Authors

Publication Details

Journal
International Journal of Computer Applications
Published
2025-08-20
DOI
https://doi.org/10.5120/ijca2025925560
Citations
1
Primary Topic
Multimodal Machine Learning Applications
Type
article
Field-Weighted Citation Impact
1.28
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

When Better Eyes Lead to Blindness: A Diagnostic Study of the Information Bottleneck in CNN-LSTM Image Captioning Models

Himaanshu Gupta
1 citations
International Journal of Computer Applications
Multimodal Machine Learning Applications
1.28
article

When Better Eyes Lead to Blindness: A Diagnostic Study of the Information Bottleneck in CNN-LSTM Image Captioning Models

Himaanshu Gupta
article en
1 citations

Abstract

Image captioning, situated at the intersection of computer vision and natural language processing, requires a sophisticated understanding of both visual scenes and linguistic structure.While modern approaches are dominated by large-scale Transformer architectures, this paper documents a systematic, iterative development of foundational image captioning models, progressing from a simple CNN-LSTM encoder-decoder to a competitive attention-based system.This paper presents a series of five models, beginning with Genesis and concluding with Nexus, an advanced model featuring an EfficientNetV2B3 backbone and a dynamic attention mechanism.The experiments chart the impact of architectural enhancements and demonstrate a key finding within the classic CNN-LSTM paradigm: merely upgrading the visual backbone without a corresponding attention mechanism can degrade performance, as the single-vector bottleneck cannot transmit the richer visual detail.This insight validates the architectural shift to attention.Trained on the MS COCO 2017 dataset, the final model, Nexus, achieves a BLEU-4 score of 31.4,surpassing several foundational benchmarks and validating the iterative design process.This work provides a clear, replicable blueprint for understanding the core architectural principles that underpin modern vision-language tasks.

International Journal of Computer ApplicationsVol. 187(31)
Reduced inequalities
Openalex Percentile: Top 17%
Multimodal Machine Learning Applications
1.28
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.