Comparing the Pre-Trained Models with LSTM Combination to Improve Image Captioning Technology

Image captioning, integrating computer vision and natural language processing, has become one of the critical areas of work for better accessibility and advancing technology. In this study, the performance of pre-trained convolutional neural networks-DenseNet, VGG-16, ResNet, and Xception-has been evaluated when coupled with LSTM units for generating captions on Flickr8k. These models have been evaluated on the basis of BLEU and ROUGE scores. The best scores were produced by ResNet-LSTM, which indicates the model's stronger ability to produce captions that are accurate and contextual. VGG-16 with LSTM ranked second; it was almost on par. Xception with LSTM gave results that were moderate. DenseNet with LSTM had the worst score, indicating that the feature extraction mechanism of this model is weak. The following results provide evidence for the practical use of ResNet-LSTM to facilitate access: from assistive technology for visually impaired users to automatically generated content. The comparative study would further indicate which one has more merits or drawbacks compared with others and thereby enable a more informed selection of the models suitable for each particular application.

Authors

Institutions

Publication Details

Published
2025-02-21
DOI
https://doi.org/10.1109/icicacs65178.2025.10967925
Primary Topic
Multimodal Machine Learning Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Comparing the Pre-Trained Models with LSTM Combination to Improve Image Captioning Technology

Tripty Singh, Mansi Sharma, L D Mukil
Multimodal Machine Learning Applications
article

Comparing the Pre-Trained Models with LSTM Combination to Improve Image Captioning Technology

Tripty Singh, Mansi Sharma, L D Mukil
article en

Abstract

Image captioning, integrating computer vision and natural language processing, has become one of the critical areas of work for better accessibility and advancing technology. In this study, the performance of pre-trained convolutional neural networks-DenseNet, VGG-16, ResNet, and Xception-has been evaluated when coupled with LSTM units for generating captions on Flickr8k. These models have been evaluated on the basis of BLEU and ROUGE scores. The best scores were produced by ResNet-LSTM, which indicates the model's stronger ability to produce captions that are accurate and contextual. VGG-16 with LSTM ranked second; it was almost on par. Xception with LSTM gave results that were moderate. DenseNet with LSTM had the worst score, indicating that the feature extraction mechanism of this model is weak. The following results provide evidence for the practical use of ResNet-LSTM to facilitate access: from assistive technology for visually impaired users to automatically generated content. The comparative study would further indicate which one has more merits or drawbacks compared with others and thereby enable a more informed selection of the models suitable for each particular application.

Graphic Era University (IN), Amrita Vishwa Vidyapeetham (IN)
Openalex Percentile: Top 93%
Multimodal Machine Learning Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.