SATURN: Autoregressive Image Generation Guided by Scene Graphs

State-of-the-art text-to-image models can generate photorealistic images, yet they often struggle to accurately capture the layout and object relationships implied by complex prompts. Scene graphs provide the missing structural signal. However, prior graph-guided generators have typically relied on heavy GAN or diffusion architectures, which lag behind modern autoregressive pipelines in terms of speed and fidelity. In this work, we introduce SATURN (Structured Arrangement of Triplets for Unified Rendering Networks), a lightweight, drop-in extension to VAR-CLIP that translates a scene graph into a salience-ordered token sequence, enabling a frozen CLIP–VQ-VAE backbone to parse the graph while fine-tuning only the VAR transformer. Empirically, on the Visual Genome dataset, SATURN reduces the FID score from 56.45% to 21.62% and raises the Inception Score from 16.03% to 24.78%, achieving gains that outperform SG2IM and SGDiff without requiring additional modules or multistage training. Notably, our qualitative results further confirm improvements in object count fidelity and spatial relation accuracy.

Authors

Institutions

Publication Details

Published
2025-08-14
DOI
https://doi.org/10.1109/mapr67746.2025.11133881
Citations
1
Primary Topic
Image Retrieval and Classification Techniques
Type
article
Field-Weighted Citation Impact
1.28
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

SATURN: Autoregressive Image Generation Guided by Scene Graphs

Tam Nguyen, Tam Dinh Le Vo, Trong-Thuan Nguyen, Minh–Triet Tran
1 citations
Image Retrieval and Classification Techniques
1.28
article

SATURN: Autoregressive Image Generation Guided by Scene Graphs

Tam Nguyen, Tam Dinh Le Vo, Trong-Thuan Nguyen, Minh–Triet Tran
article en
1 citations

Abstract

State-of-the-art text-to-image models can generate photorealistic images, yet they often struggle to accurately capture the layout and object relationships implied by complex prompts. Scene graphs provide the missing structural signal. However, prior graph-guided generators have typically relied on heavy GAN or diffusion architectures, which lag behind modern autoregressive pipelines in terms of speed and fidelity. In this work, we introduce SATURN (Structured Arrangement of Triplets for Unified Rendering Networks), a lightweight, drop-in extension to VAR-CLIP that translates a scene graph into a salience-ordered token sequence, enabling a frozen CLIP–VQ-VAE backbone to parse the graph while fine-tuning only the VAR transformer. Empirically, on the Visual Genome dataset, SATURN reduces the FID score from 56.45% to 21.62% and raises the Inception Score from 16.03% to 24.78%, achieving gains that outperform SG2IM and SGDiff without requiring additional modules or multistage training. Notably, our qualitative results further confirm improvements in object count fidelity and spatial relation accuracy.

Vietnam National University Ho Chi Minh City (VN), University of Dayton (US)
Openalex Percentile: Top 16%
Image Retrieval and Classification Techniques
1.28
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

SATURN: Autoregressive Image Generation Guided by Scene Graphs — Tam Nguyen, Tam Dinh Le Vo, et al. · (2025) | TGRS Research Map | TGRS