Diffusion Explainer: Visual Explanation for Text-to-image Stable Diffusion

Diffusion-based generative models’ impressive ability to create convincing images has garnered global attention. However, their complex structures and operations often pose challenges for non-experts to grasp. We present Diffusion Explainer, the first interactive visualization tool that explains how Stable Diffusion transforms text prompts into images. Diffusion Explainer tightly integrates a visual overview of Stable Diffusion’s complex structure with explanations of the underlying operations. By comparing image generation of prompt variants, users can discover the impact of keyword changes on image generation. A 56-participant user study demonstrates that Diffusion Explainer offers substantial learning benefits to non-experts. Our tool has been used by over 10,300 users from 124 countries at https://poloclub.github.io/diffusion-explainer/.

Authors

Institutions

Publication Details

Published
2024-10-13
DOI
https://doi.org/10.1109/vis55277.2024.00027
Citations
15
Primary Topic
Digital Humanities and Scholarship
Type
article
Field-Weighted Citation Impact
58.63
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Diffusion Explainer: Visual Explanation for Text-to-image Stable Diffusion

Shengyun Peng, Duen Horng Chau, Haekyu Park, Kevin Li et al.
15 citations
Digital Humanities and Scholarship
58.63
article

Diffusion Explainer: Visual Explanation for Text-to-image Stable Diffusion

Shengyun Peng, Duen Horng Chau, Haekyu Park, Kevin Li, Benjamin Hoover, Hendrik Strobelt, Austin L. Wright, Haoyang Yang, Zijie J. Wang, Seongmin Lee
article en
15 citations

Abstract

Diffusion-based generative models’ impressive ability to create convincing images has garnered global attention. However, their complex structures and operations often pose challenges for non-experts to grasp. We present Diffusion Explainer, the first interactive visualization tool that explains how Stable Diffusion transforms text prompts into images. Diffusion Explainer tightly integrates a visual overview of Stable Diffusion’s complex structure with explanations of the underlying operations. By comparing image generation of prompt variants, users can discover the impact of keyword changes on image generation. A 56-participant user study demonstrates that Diffusion Explainer offers substantial learning benefits to non-experts. Our tool has been used by over 10,300 users from 124 countries at https://poloclub.github.io/diffusion-explainer/.

Georgia Institute of Technology (US)
Openalex Percentile: Top 0%
Digital Humanities and Scholarship
58.63
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.