Automated AI-Based Image Captioning: A Transformer-Based Approach for Natural Language Generation from Visual Data

Image captioning is essential in computer vision and Natural Language Processing (NLP) to produce relevant textual descriptions from visual information. This paper demonstrates a transformer architecture for deep-learning image captioning that uses attention mechanisms in Transformers to produce improved captions. The parallel processing capability of transformers makes them different from conventional CNN-RNN-based models and allows faster training with better contextual understanding. The research explores Vision Transformer (ViT) and Contrastive Language-Image Pretraining (CLIP) as transformer-based models that work with language models to create superior captioning results. The proposed methodology performs better than conventional models after demonstrating high results on benchmark datasets MS COCO and Flickr8k.Experimental evaluations demonstrate that our technique leads to enhanced scores for BLEU, METEOR and CIDEr metrics, thus proving its effectiveness.The paper investigates forthcoming prospects and present obstacles in automated image captioning technology.

Authors

Institutions

Publication Details

Journal
International Journal of Multidisciplinary on Science and Management
Published
2025-04-22
DOI
https://doi.org/10.64137/30485037/v2i2p105
Primary Topic
Multimodal Machine Learning Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Automated AI-Based Image Captioning: A Transformer-Based Approach for Natural Language Generation from Visual Data

Rahul Cherekar
International Journal of Multidisciplinary on Science and Management
Multimodal Machine Learning Applications
article

Automated AI-Based Image Captioning: A Transformer-Based Approach for Natural Language Generation from Visual Data

Rahul Cherekar
article en

Abstract

Image captioning is essential in computer vision and Natural Language Processing (NLP) to produce relevant textual descriptions from visual information. This paper demonstrates a transformer architecture for deep-learning image captioning that uses attention mechanisms in Transformers to produce improved captions. The parallel processing capability of transformers makes them different from conventional CNN-RNN-based models and allows faster training with better contextual understanding. The research explores Vision Transformer (ViT) and Contrastive Language-Image Pretraining (CLIP) as transformer-based models that work with language models to create superior captioning results. The proposed methodology performs better than conventional models after demonstrating high results on benchmark datasets MS COCO and Flickr8k.Experimental evaluations demonstrate that our technique leads to enhanced scores for BLEU, METEOR and CIDEr metrics, thus proving its effectiveness.The paper investigates forthcoming prospects and present obstacles in automated image captioning technology.

International Journal of Multidisciplinary on Science and ManagementVol. 2(2)
Film Independent (US)
Quality Education
Openalex Percentile: Top 79%
Multimodal Machine Learning Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.