Research on Text-to-Image Generation Model Based on Spatial Transformer Network Mechanism

The challenges of text-guided image generation technology mainly involve ensuring the semantic consistency of images and their visual realism, as well as enhancing the accuracy and trustworthiness of image generation. In view of the quality limitations exhibited by single - stage models during the image generation process, this paper presents a method to boost the semantic consistency between text descriptions and generated images. By incorporating the attention mechanism, the integration of cross - modal features between text and images is realized. Through the introduction of the spatial transform network model into the discriminator, the model only needs to concentrate on the image regions that are highly relevant to the text description, instead of all regions, thereby avoiding resource waste. By transforming and adjusting the local regions of the input image, it becomes possible to process and represent the spatial information of the image more precisely. Through experimental verification, the model proposed in this paper shows an improvement in the quality of generating complex scene images based on text descriptions. On the COCO dataset, the Inception Score (IS) has increased by 1.2%, and the Frechet Inception Distance (FID) has decreased by 0.61%. This result clearly demonstrates that the single - stage generation model integrated with the spatial transform network mechanism can generate more diverse images that are closer to real -world scenes.

Authors

Publication Details

Published
2025-03-14
DOI
https://doi.org/10.1109/itoec63606.2025.10968091
Primary Topic
Simulation and Modeling Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Research on Text-to-Image Generation Model Based on Spatial Transformer Network Mechanism

Yu Zhou, Yi Wang
Simulation and Modeling Applications
article

Research on Text-to-Image Generation Model Based on Spatial Transformer Network Mechanism

Yu Zhou, Yi Wang
article en

Abstract

The challenges of text-guided image generation technology mainly involve ensuring the semantic consistency of images and their visual realism, as well as enhancing the accuracy and trustworthiness of image generation. In view of the quality limitations exhibited by single - stage models during the image generation process, this paper presents a method to boost the semantic consistency between text descriptions and generated images. By incorporating the attention mechanism, the integration of cross - modal features between text and images is realized. Through the introduction of the spatial transform network model into the discriminator, the model only needs to concentrate on the image regions that are highly relevant to the text description, instead of all regions, thereby avoiding resource waste. By transforming and adjusting the local regions of the input image, it becomes possible to process and represent the spatial information of the image more precisely. Through experimental verification, the model proposed in this paper shows an improvement in the quality of generating complex scene images based on text descriptions. On the COCO dataset, the Inception Score (IS) has increased by 1.2%, and the Frechet Inception Distance (FID) has decreased by 0.61%. This result clearly demonstrates that the single - stage generation model integrated with the spatial transform network mechanism can generate more diverse images that are closer to real -world scenes.

Openalex Percentile: Top 91%
Simulation and Modeling Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Research on Text-to-Image Generation Model Based on Spatial Transformer Network Mechanism — Yu Zhou, Yi Wang · (2025) | TGRS Research Map | TGRS