Flow-WLS under quantization: low-order multistep samplers for guided and INT8 flow-matching models

Summary. We measured how multistep ODE samplers behave on flow-matching image models at 8-24 steps, when the model is quantized to INT8 and when classifier-free guidance (CFG) is used. Our earlier preprint (10.5281/zenodo.23337579) proposed Flow-WLS, a regularized multistep sampler, and the working expectation was that it would damp quantization noise. The measurements do not support that expectation, and this record reports the results as they are, including the refuted hypotheses. Main results. The error of real INT8 kernels (ComfyUI, Flux3-Klein) is white in time: lag-1 correlation of the velocity error -0.001. Its size is 1.3% of the velocity norm at CFG 1 and 5.7% at CFG 4 (a factor of 4.36). The effect on the final latent is about 0.02 or less, and the LPIPS distance between the converged images of the INT8 kernels and of the same weights dequantized to bf16 is 0.014 (CFG 1) and 0.029 (CFG 4). The choice of sampler changes the final error by 0.05-0.8, quantization by 0.02 at most. Adams-Bashforth of order 4 and the long-window Flow-WLS-8 were not the best choice at 12 steps or fewer in any tested model. White-noise gain relative to Euler: 1.06 (AB-2), 1.21 (AB-3), 1.97 (AB-4). The best simple rule depends on guidance. At CFG 3 and above AB-2 beats Euler in 12 of 12 (CFG, budget) cells on Anima, and DPM++ 2M overtakes Euler from 16-24 steps; for distilled models without guidance (Flux3-Klein, Krea 2 at CFG 1) AB-3 (together with the dynamic rule) gave the lowest error. Measured mechanism: the guided velocity is a smooth trend plus a jitter that is uncorrelated from step to step, about 1% of the norm at CFG 1, 4% at CFG 3 and 6-7% at CFG 5. The guidance term is redrawn at every step. A constant-weight linear history filter fitted to the data improves on the best existing rule by at most 3.4% (leave-one-unit-out), so no new sampler of the Flow-WLS class is justified. Setup. Anima (bf16 with simulated FP8/INT8/INT4/NVFP4), Flux3-Klein INT8, Krea 2 INT8 (ConvRot), Moss-Image INT8; 4 prompts, 2-3 seeds, 8-24 steps, CFG 1-5. Hypotheses H1-H15 were registered in the README before the corresponding measurements (six before the first experiments, nine before the follow-up); paired bootstrap intervals are reported against Euler. For Flux3 the real INT8 path (Q) is compared with the same weights dequantized to bf16 (D). Software. The code adds flow_ab2, flow_ab3 and flow_ab4 to the standard ComfyUI sampler list and a one-choice node "Flow Easy Sampler". Experiments, tables (results/) and image grids (figures/) are in the repository: github.com/YakovSava/flow-wls-research. Limitations. LPIPS measures distance to a many-step image, not preference; no human preference test was done. Four prompts and four models; one seed per displayed image, no seed selection. The "converged" reference does not converge for Moss-Image and only roughly (20-34%) for Flux3 at CFG 4, so only large effects are interpreted there. Moss-Image and Krea 2 were measured in Q mode only. The rounding error of the INT8 weights against an unknown bf16 original was not measured. AB-2 and DPM++ 2M were added to part of the experiments after the first results (marked in the README). Models with epsilon prediction (SDXL-like) were not tested.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-11-04
DOI
https://doi.org/10.5281/zenodo.23939695
Primary Topic
Generative Adversarial Networks and Image Synthesis
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

Flow-WLS under quantization: low-order multistep samplers for guided and INT8 flow-matching models

Iakov Savelev
Zenodo (CERN European Organization for Nuclear Research)
Generative Adversarial Networks and Image Synthesis
preprint

Flow-WLS under quantization: low-order multistep samplers for guided and INT8 flow-matching models

Iakov Savelev
preprint en

Abstract

Summary. We measured how multistep ODE samplers behave on flow-matching image models at 8-24 steps, when the model is quantized to INT8 and when classifier-free guidance (CFG) is used. Our earlier preprint (10.5281/zenodo.23337579) proposed Flow-WLS, a regularized multistep sampler, and the working expectation was that it would damp quantization noise. The measurements do not support that expectation, and this record reports the results as they are, including the refuted hypotheses. Main results. The error of real INT8 kernels (ComfyUI, Flux3-Klein) is white in time: lag-1 correlation of the velocity error -0.001. Its size is 1.3% of the velocity norm at CFG 1 and 5.7% at CFG 4 (a factor of 4.36). The effect on the final latent is about 0.02 or less, and the LPIPS distance between the converged images of the INT8 kernels and of the same weights dequantized to bf16 is 0.014 (CFG 1) and 0.029 (CFG 4). The choice of sampler changes the final error by 0.05-0.8, quantization by 0.02 at most. Adams-Bashforth of order 4 and the long-window Flow-WLS-8 were not the best choice at 12 steps or fewer in any tested model. White-noise gain relative to Euler: 1.06 (AB-2), 1.21 (AB-3), 1.97 (AB-4). The best simple rule depends on guidance. At CFG 3 and above AB-2 beats Euler in 12 of 12 (CFG, budget) cells on Anima, and DPM++ 2M overtakes Euler from 16-24 steps; for distilled models without guidance (Flux3-Klein, Krea 2 at CFG 1) AB-3 (together with the dynamic rule) gave the lowest error. Measured mechanism: the guided velocity is a smooth trend plus a jitter that is uncorrelated from step to step, about 1% of the norm at CFG 1, 4% at CFG 3 and 6-7% at CFG 5. The guidance term is redrawn at every step. A constant-weight linear history filter fitted to the data improves on the best existing rule by at most 3.4% (leave-one-unit-out), so no new sampler of the Flow-WLS class is justified. Setup. Anima (bf16 with simulated FP8/INT8/INT4/NVFP4), Flux3-Klein INT8, Krea 2 INT8 (ConvRot), Moss-Image INT8; 4 prompts, 2-3 seeds, 8-24 steps, CFG 1-5. Hypotheses H1-H15 were registered in the README before the corresponding measurements (six before the first experiments, nine before the follow-up); paired bootstrap intervals are reported against Euler. For Flux3 the real INT8 path (Q) is compared with the same weights dequantized to bf16 (D). Software. The code adds flow_ab2, flow_ab3 and flow_ab4 to the standard ComfyUI sampler list and a one-choice node "Flow Easy Sampler". Experiments, tables (results/) and image grids (figures/) are in the repository: github.com/YakovSava/flow-wls-research. Limitations. LPIPS measures distance to a many-step image, not preference; no human preference test was done. Four prompts and four models; one seed per displayed image, no seed selection. The "converged" reference does not converge for Moss-Image and only roughly (20-34%) for Flux3 at CFG 4, so only large effects are interpreted there. Moss-Image and Krea 2 were measured in Q mode only. The rounding error of the INT8 weights against an unknown bf16 original was not measured. AB-2 and DPM++ 2M were added to part of the experiments after the first results (marked in the README). Models with epsilon prediction (SDXL-like) were not tested.

Zenodo (CERN European Organization for Nuclear Research)
Generative Adversarial Networks and Image Synthesis
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon