Enhanced Text-to-Image Synthesis Using Generative Adversarial Networks and Skip-Thought Vectors for Improved Visual and Semantic Accuracy

Creating realistic images from textual descriptions is a major challenge in computer vision and natural language processing. Traditional methods often fail to accurately translate text into visual representations, resulting in images that lack detail and context. This study addresses this issue by combining Generative Adversarial Networks (GANs) with Skip-Thought Vectors.The proposed approach involves three key stages. First, textual descriptions are embedded using Skip-Thought Vectors, which utilize a Recurrent Neural Network (RNN) encoder with Gated Recurrent Unit (GRU) activation to capture semantic nuances. Next, low-resolution images are generated using GANs, providing a basic visual structure. Finally, these images are refined to high resolution to ensure they are detailed and contextually accurate.This method was validated using the Caltech-UCSD Birds 200 (CUB-200) dataset, showing notable improvements in both visual quality and semantic accuracy over previous methods. This approach enables the generation of detailed and contextually relevant images from text, with potential applications in design, storytelling, e-commerce, and accessibility.By automating the generation of high-quality images from text, this research enhances user experience and opens new possibilities for creative and practical uses, marking a significant advancement in the integration of computer vision and natural language processing.

Authors

Institutions

Publication Details

Published
2024-08-23
DOI
https://doi.org/10.1109/iacis61494.2024.10721722
Citations
1
Primary Topic
Generative Adversarial Networks and Image Synthesis
Type
article
Field-Weighted Citation Impact
0.25
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Enhanced Text-to-Image Synthesis Using Generative Adversarial Networks and Skip-Thought Vectors for Improved Visual and Semantic Accuracy

Manoj Kumar M V, H R Sneha, B S Prashanth, D Monisha et al.
1 citations
Generative Adversarial Networks and Image Synthesis
0.25
article

Enhanced Text-to-Image Synthesis Using Generative Adversarial Networks and Skip-Thought Vectors for Improved Visual and Semantic Accuracy

Manoj Kumar M V, H R Sneha, B S Prashanth, D Monisha, D. Keerthana, B H Puneeth
article en
1 citations

Abstract

Creating realistic images from textual descriptions is a major challenge in computer vision and natural language processing. Traditional methods often fail to accurately translate text into visual representations, resulting in images that lack detail and context. This study addresses this issue by combining Generative Adversarial Networks (GANs) with Skip-Thought Vectors.The proposed approach involves three key stages. First, textual descriptions are embedded using Skip-Thought Vectors, which utilize a Recurrent Neural Network (RNN) encoder with Gated Recurrent Unit (GRU) activation to capture semantic nuances. Next, low-resolution images are generated using GANs, providing a basic visual structure. Finally, these images are refined to high resolution to ensure they are detailed and contextually accurate.This method was validated using the Caltech-UCSD Birds 200 (CUB-200) dataset, showing notable improvements in both visual quality and semantic accuracy over previous methods. This approach enables the generation of detailed and contextually relevant images from text, with potential applications in design, storytelling, e-commerce, and accessibility.By automating the generation of high-quality images from text, this research enhances user experience and opens new possibilities for creative and practical uses, marking a significant advancement in the integration of computer vision and natural language processing.

Bapuji Institute of Engineering and Technology
Openalex Percentile: Top 46%
Generative Adversarial Networks and Image Synthesis
0.25
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.