Research on fine-grained image description generation method based on deep learning

With the rapid development of deep learning technology, image description generation has emerged as a hot research direction in the field of artificial intelligence, aiming to interpret image content through automatically generated natural language descriptions. Particularly, fine-grained image description generation, which delves into the detailed information within images to provide richer and more precise descriptions, holds broad application prospects, including aiding navigation for the visually impaired, automatic content creation, and augmented reality, among others. This study explores the technology of fine-grained image description generation, proposing a deep learning model that integrates Convolutional Neural Networks (CNNs) and Recurrent Neural Networks (RNNs) to enhance the quality and accuracy of image descriptions. We employed a composite loss function to refine the model’s training process and introduced an attention mechanism to better capture key information in images. Through experimental validation on multiple public datasets, our model demonstrated superior performance to existing technologies. Additionally, we analyzed key factors affecting model performance and discussed potential directions for future improvements. The outcomes of this study not only provide an effective method for fine-grained image description generation but also pave new pathways for the application of deep learning technology in image understanding and natural language processing.

Authors

Institutions

Publication Details

Published
2024-10-23
DOI
https://doi.org/10.1109/iccasit62299.2024.10828095
Primary Topic
Image Retrieval and Classification Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Research on fine-grained image description generation method based on deep learning

Xiaosong Su, Wuqiang Shen, Yechao Wang, Chaosheng Yao
Image Retrieval and Classification Techniques
article

Research on fine-grained image description generation method based on deep learning

Xiaosong Su, Wuqiang Shen, Yechao Wang, Chaosheng Yao
article en

Abstract

With the rapid development of deep learning technology, image description generation has emerged as a hot research direction in the field of artificial intelligence, aiming to interpret image content through automatically generated natural language descriptions. Particularly, fine-grained image description generation, which delves into the detailed information within images to provide richer and more precise descriptions, holds broad application prospects, including aiding navigation for the visually impaired, automatic content creation, and augmented reality, among others. This study explores the technology of fine-grained image description generation, proposing a deep learning model that integrates Convolutional Neural Networks (CNNs) and Recurrent Neural Networks (RNNs) to enhance the quality and accuracy of image descriptions. We employed a composite loss function to refine the model’s training process and introduced an attention mechanism to better capture key information in images. Through experimental validation on multiple public datasets, our model demonstrated superior performance to existing technologies. Additionally, we analyzed key factors affecting model performance and discussed potential directions for future improvements. The outcomes of this study not only provide an effective method for fine-grained image description generation but also pave new pathways for the application of deep learning technology in image understanding and natural language processing.

China Southern Power Grid (China) (CN)
Openalex Percentile: Top 75%
Image Retrieval and Classification Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Research on fine-grained image description generation method based on deep learning — Xiaosong Su, Wuqiang Shen, et al. · (2024) | TGRS Research Map | TGRS