Efficient calibration dataset sampling for post-training quantization of diffusion models

Diffusion models have emerged as a leading method for generating diverse and realistic samples, revolutionizing tasks like text-to-image generation, super-resolution, and inpainting. However, their slow sampling process hampers implementation. This work focuses on post-training quantization (PTQ) optimization for diffusion models. We propose an error-contribution-aware calibration dataset sampling scheme, effectively reducing calibration dataset size while preserving model precision. Experimental results demonstrate the effectiveness of our approach, achieving performance comparable to uniform sampling methods with a significant reduction in calibration dataset size.

Authors

Institutions

Publication Details

Published
2024-09-27
DOI
https://doi.org/10.1117/12.3037447
Primary Topic
Advanced Neuroimaging Techniques and Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Efficient calibration dataset sampling for post-training quantization of diffusion models

Kun Zhao, Yanwei Wang, Wei Huang, Yu Ming Victor Fang et al.
Advanced Neuroimaging Techniques and Applications
article

Efficient calibration dataset sampling for post-training quantization of diffusion models

Kun Zhao, Yanwei Wang, Wei Huang, Yu Ming Victor Fang, Kefeng Zhu, Yujie Dai, Le Yang
article en

Abstract

Diffusion models have emerged as a leading method for generating diverse and realistic samples, revolutionizing tasks like text-to-image generation, super-resolution, and inpainting. However, their slow sampling process hampers implementation. This work focuses on post-training quantization (PTQ) optimization for diffusion models. We propose an error-contribution-aware calibration dataset sampling scheme, effectively reducing calibration dataset size while preserving model precision. Experimental results demonstrate the effectiveness of our approach, achieving performance comparable to uniform sampling methods with a significant reduction in calibration dataset size.

Inspur (China) (CN)
Openalex Percentile: Top 72%
Advanced Neuroimaging Techniques and Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Efficient calibration dataset sampling for post-training quantization of diffusion models — Kun Zhao, Yanwei Wang, et al. · (2024) | TGRS Research Map | TGRS