Layerwise Weight Statistics and Pell-Inspired Quantization for SDXL: An Exploratory Technical Note on Calibration-Free Weight Quantization

This technical note explores a weight-statistics-based approach to neural network quantization, centered on a layerwise amplitude-to-dispersion statistic defined as the ratio of the maximum absolute weight to its standard deviation. Preliminary measurements across ResNet-18, BERT-base, and Stable Diffusion XL (SDXL) suggest one robust observation: this statistic exhibits substantially lower empirical dispersion in trained feed-forward and convolutional families than in cross-attention families. This differential behavior may inform family-specific quantization strategies. Building on this, we investigate a weight-only quantization heuristic incorporating an exploratory arithmetic anchor derived from the Pell norm form sequence in ℤ[√2] (D5 = 839). We evaluate condition-number-guided routing strategies to preserve highly anisotropic attention projections. A preliminary SDXL evaluation (100 PartiPrompts) reports semantic alignment, structural similarity, and memory consumption. We emphasize that the amplitude statistic is not derived from first principles, and the Pell-derived anchor is presented openly as an exploratory implementation rather than a theoretically established optimum. We welcome alternative arithmetic anchors and independent investigation of these hypotheses. Research status: Exploratory technical note. Not peer-reviewed.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-11-16
DOI
https://doi.org/10.5281/zenodo.24290303
Primary Topic
Advanced Neural Network Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Layerwise Weight Statistics and Pell-Inspired Quantization for SDXL: An Exploratory Technical Note on Calibration-Free Weight Quantization

Samuel Moulin
Zenodo (CERN European Organization for Nuclear Research)
Advanced Neural Network Applications
article

Layerwise Weight Statistics and Pell-Inspired Quantization for SDXL: An Exploratory Technical Note on Calibration-Free Weight Quantization

Samuel Moulin
article en

Abstract

This technical note explores a weight-statistics-based approach to neural network quantization, centered on a layerwise amplitude-to-dispersion statistic defined as the ratio of the maximum absolute weight to its standard deviation. Preliminary measurements across ResNet-18, BERT-base, and Stable Diffusion XL (SDXL) suggest one robust observation: this statistic exhibits substantially lower empirical dispersion in trained feed-forward and convolutional families than in cross-attention families. This differential behavior may inform family-specific quantization strategies. Building on this, we investigate a weight-only quantization heuristic incorporating an exploratory arithmetic anchor derived from the Pell norm form sequence in ℤ[√2] (D5 = 839). We evaluate condition-number-guided routing strategies to preserve highly anisotropic attention projections. A preliminary SDXL evaluation (100 PartiPrompts) reports semantic alignment, structural similarity, and memory consumption. We emphasize that the amplitude statistic is not derived from first principles, and the Pell-derived anchor is presented openly as an exploratory implementation rather than a theoretically established optimum. We welcome alternative arithmetic anchors and independent investigation of these hypotheses. Research status: Exploratory technical note. Not peer-reviewed.

Zenodo (CERN European Organization for Nuclear Research)
Advanced Neural Network Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon