Recognizing geographical locations using a GAN-based text-to-image approach

Generating photo-realistic images that align with the text descriptions is the goal of the text-to-image generation (T2I) model. They can assist in visualizing the descriptions thanks to advancements in machine learning algorithms. Using text as a source, generative adversarial networks (GANs) can generate a series of pictures that serve as descriptions. Recent GANs have allowed oldest T2I models to achieve remarkable gains. However, they have some limitations. The main target of this study is to address these limitations to enhance the text-to-image generation models to enhance location services. To produce high-quality photos utilizing a multi-step approach, we build an attentional generating network called AttnGAN. The fine-grained image-text matching loss needed to train the AttnGAN’s generator is computed using our multimodal similarity model. With an inception score of 4.81 on the PatternNet dataset, our AttnGAN model achieves an impressive R-precision value of 70.61 percent. Because the PatternNet dataset comprises photographs, we’ve added verbal descriptions to each one to make it a text-based dataset instead. Many experiments have shown that AttnGAN’s proposed attention procedures, which are critical for text-to-image production in complex circumstances, are effective.

Authors

Institutions

Publication Details

Journal
Indonesian Journal of Electrical Engineering and Computer Science
Published
2024-11-29
DOI
https://doi.org/10.11591/ijeecs.v37.i2.pp1168-1182
Primary Topic
Geographic Information Systems Studies
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Recognizing geographical locations using a GAN-based text-to-image approach

Amal A. Al-Shargabi, Dina M. Ibrahim
Indonesian Journal of Electrical Engineering and Computer Science
Geographic Information Systems Studies
article

Recognizing geographical locations using a GAN-based text-to-image approach

Amal A. Al-Shargabi, Dina M. Ibrahim
article en

Abstract

Generating photo-realistic images that align with the text descriptions is the goal of the text-to-image generation (T2I) model. They can assist in visualizing the descriptions thanks to advancements in machine learning algorithms. Using text as a source, generative adversarial networks (GANs) can generate a series of pictures that serve as descriptions. Recent GANs have allowed oldest T2I models to achieve remarkable gains. However, they have some limitations. The main target of this study is to address these limitations to enhance the text-to-image generation models to enhance location services. To produce high-quality photos utilizing a multi-step approach, we build an attentional generating network called AttnGAN. The fine-grained image-text matching loss needed to train the AttnGAN’s generator is computed using our multimodal similarity model. With an inception score of 4.81 on the PatternNet dataset, our AttnGAN model achieves an impressive R-precision value of 70.61 percent. Because the PatternNet dataset comprises photographs, we’ve added verbal descriptions to each one to make it a text-based dataset instead. Many experiments have shown that AttnGAN’s proposed attention procedures, which are critical for text-to-image production in complex circumstances, are effective.

Indonesian Journal of Electrical Engineering and Computer ScienceVol. 37(2)
Qassim University (SA)
Qassim University
Openalex Percentile: Top 65%
Geographic Information Systems Studies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.