QPP: Parametric Compression via Quantile Curves for Large Language Models
We present QPP (Quantile Piecewise Perceptron), a novel parametric compression technique that reduces the number of parameters rather than just their bit precision. QPP represents each weight matrix row as a quantile curve fitted with 32 anchors and block-shared ordering. Combined with a 2-bit codebook over anchors and INT8/INT4 quantization for incompatible layers, our hybrid pipeline achieves 41.1% compression on Qwen3-4B (8,045 to 4,738 MB) with coherent generation. QPP is 7x more effective than GGUF Q4_K_M on attention layers (21x vs 3.2x) and 69% faster at inference with cached weights. We also built a physical QPP+GGUF combined file demonstrating orthogonal compression axes.
Authors
- Ignacio Fernando Suarez Hernandez
Publication Details
- Journal
- Zenodo (CERN European Organization for Nuclear Research)
- Published
- 2026-06-29
- DOI
- https://doi.org/10.5281/zenodo.21046683
- Primary Topic
- Natural Language Processing Techniques
- Type
- preprint