Text-to-Image Generation Method Based on Attention and Dual-Residual Module

The goal of text-based image generation is to create premium and authentic images conditioned on specific textual descriptions. The main challenges in this assignment include improving image quality and achieving a deep integration between the image and textual information. To address these issues, this paper presents a novel Generative Adversarial Network (ADR-GAN) model, which is optimized through the incorporation of attention mechanisms and dual residual modules. Specifically, ADR-GAN employs two innovative word-level attention modules-channel attention and spatial attention modules - to model word information from different perspectives, thereby significantly enhancing semantic consistency. To accelerate convergence and enhance image detail vividness, a dual residual module is developed, which supports deeper network architectures while preserving more original visual features. Furthermore, a word-level discriminator is introduced to furnish the generator with detailed feedback on each individual word. Compared to previous methods, ADR-GAN excels in generating realistic and text-aligned images, achieving a commendable balance between quality and semantic consistency, and demonstrates superior performance in benchmark tests.

Authors

Institutions

Publication Details

Published
2024-09-27
DOI
https://doi.org/10.1109/eiecs63941.2024.10800261
Primary Topic
Video Analysis and Summarization
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Text-to-Image Generation Method Based on Attention and Dual-Residual Module

Xiaoling Tan, Peng Fang, Eugene T. Lin, Fan Wang
Video Analysis and Summarization
article

Text-to-Image Generation Method Based on Attention and Dual-Residual Module

Xiaoling Tan, Peng Fang, Eugene T. Lin, Fan Wang
article en

Abstract

The goal of text-based image generation is to create premium and authentic images conditioned on specific textual descriptions. The main challenges in this assignment include improving image quality and achieving a deep integration between the image and textual information. To address these issues, this paper presents a novel Generative Adversarial Network (ADR-GAN) model, which is optimized through the incorporation of attention mechanisms and dual residual modules. Specifically, ADR-GAN employs two innovative word-level attention modules-channel attention and spatial attention modules - to model word information from different perspectives, thereby significantly enhancing semantic consistency. To accelerate convergence and enhance image detail vividness, a dual residual module is developed, which supports deeper network architectures while preserving more original visual features. Furthermore, a word-level discriminator is introduced to furnish the generator with detailed feedback on each individual word. Compared to previous methods, ADR-GAN excels in generating realistic and text-aligned images, achieving a commendable balance between quality and semantic consistency, and demonstrates superior performance in benchmark tests.

Chongqing Three Gorges University (CN)
Openalex Percentile: Top 76%
Video Analysis and Summarization
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Text-to-Image Generation Method Based on Attention and Dual-Residual Module — Xiaoling Tan, Peng Fang, et al. · (2024) | TGRS Research Map | TGRS