Enhancing Automatic Image Captioning: A Systematic Analysis of Models, Datasets, and Evaluation Metrics

The fusion of computer vision and natural language processing (NLP) has given rise to the interdisciplinary field of automatic image captioning, which aims to generate descriptive text for images without human intervention. This area of research has attracted considerable interest due to its potential uses in improving accessibility, managing content, and enhancing search engine optimization. Over the past years, there has been a drastic increase in the accuracy and detail of captions thanks to recent advances in deep learning, especially with convolutional neural networks (CNNs), long short-term memory (LSTMs), and recurrent neural networks (RNNs). This research examines cutting-edge approaches to automatic image captioning, including attention mechanisms, models based on transformers, and techniques utilizing reinforcement learning. The effectiveness of these methods was evaluated using benchmark datasets, and their advantages and limitations were assessed. Additionally, the obstacles faced in producing contextually appropriate and linguistically precise captions were explored, such as dealing with intricate scenes, uncommon objects, and abstract ideas. The paper concludes by highlighting potential areas for future research, including learning across multiple modalities, captioning across languages, and incorporating common-sense knowledge to improve caption generation.

Authors

Institutions

Publication Details

Published
2024-12-12
DOI
https://doi.org/10.1109/icuis64676.2024.10866892
Primary Topic
Multimodal Machine Learning Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Enhancing Automatic Image Captioning: A Systematic Analysis of Models, Datasets, and Evaluation Metrics

S. Amutha, G. Venkata Saketh, J. Shiva Sai, K. Ganesan et al.
Multimodal Machine Learning Applications
article

Enhancing Automatic Image Captioning: A Systematic Analysis of Models, Datasets, and Evaluation Metrics

S. Amutha, G. Venkata Saketh, J. Shiva Sai, K. Ganesan, G. Vishnu Vardhan Reddy, G. Harinath Chowdary
article en

Abstract

The fusion of computer vision and natural language processing (NLP) has given rise to the interdisciplinary field of automatic image captioning, which aims to generate descriptive text for images without human intervention. This area of research has attracted considerable interest due to its potential uses in improving accessibility, managing content, and enhancing search engine optimization. Over the past years, there has been a drastic increase in the accuracy and detail of captions thanks to recent advances in deep learning, especially with convolutional neural networks (CNNs), long short-term memory (LSTMs), and recurrent neural networks (RNNs). This research examines cutting-edge approaches to automatic image captioning, including attention mechanisms, models based on transformers, and techniques utilizing reinforcement learning. The effectiveness of these methods was evaluated using benchmark datasets, and their advantages and limitations were assessed. Additionally, the obstacles faced in producing contextually appropriate and linguistically precise captions were explored, such as dealing with intricate scenes, uncommon objects, and abstract ideas. The paper concludes by highlighting potential areas for future research, including learning across multiple modalities, captioning across languages, and incorporating common-sense knowledge to improve caption generation.

KPR Institute of Engineering and Technology (IN), Kalasalingam Academy of Research and Education (IN)
Openalex Percentile: Top 73%
Multimodal Machine Learning Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Enhancing Automatic Image Captioning: A Systematic Analysis of Models, Datasets, and Evaluation Metrics — S. Amutha, G. Venkata Saketh, et al. · (2024) | TGRS Research Map | TGRS