MSRR-T2I: Multi-Scale Reverse Residual for Text-to-Image

Abstract Text-generated image is a very challenging task in the artificial intelligence and machine learning. To address the problems of low quality and no-diversity in images generated by conventional text-generated approaches, a multi-scale reverse residual text-generated image network (MSRR-T2I) is proposed in this paper. Firstly, the multi-scale residuals inverse structure is embedded into the fine image generation module to resolve the issue of loss of feature information when original residuals are reduced. Then, the information content of the feature map is extended, and the features of different resolutions are captured by multi-scale convolution. Finally, channel transformation technology is introduced to achieve cross-group information fusion and enhance image diversity. The test results of common CUB and COCO data sets indicate that compared with the original model ATTNGAN, the IS of MSRR-T2I increases by 8.7% and 8.4%, and the FID increases by 24.8% and 17.0%, respectively. Therefore, the proposed method is confirmed to be effective.

Authors

Institutions

Publication Details

Journal
Journal of Physics Conference Series
Published
2024-10-01
DOI
https://doi.org/10.1088/1742-6596/2872/1/012021
Primary Topic
Image Retrieval and Classification Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

MSRR-T2I: Multi-Scale Reverse Residual for Text-to-Image

Haowen Wu, Ruohai Di, Bo Sun, Xiaoyan Li et al.
Journal of Physics Conference Series
Image Retrieval and Classification Techniques
article

MSRR-T2I: Multi-Scale Reverse Residual for Text-to-Image

Haowen Wu, Ruohai Di, Bo Sun, Xiaoyan Li, Peng Wang, Liangliang Li, Mengyu Sun
article en

Abstract

Abstract Text-generated image is a very challenging task in the artificial intelligence and machine learning. To address the problems of low quality and no-diversity in images generated by conventional text-generated approaches, a multi-scale reverse residual text-generated image network (MSRR-T2I) is proposed in this paper. Firstly, the multi-scale residuals inverse structure is embedded into the fine image generation module to resolve the issue of loss of feature information when original residuals are reduced. Then, the information content of the feature map is extended, and the features of different resolutions are captured by multi-scale convolution. Finally, channel transformation technology is introduced to achieve cross-group information fusion and enhance image diversity. The test results of common CUB and COCO data sets indicate that compared with the original model ATTNGAN, the IS of MSRR-T2I increases by 8.7% and 8.4%, and the FID increases by 24.8% and 17.0%, respectively. Therefore, the proposed method is confirmed to be effective.

Journal of Physics Conference SeriesVol. 2872(1)
Xi'an Technological University (CN)
Quality Education
Openalex Percentile: Top 81%
Image Retrieval and Classification Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.