Flat Recall Is a Lottery at Ten Million Vectors — A Recall-vs-Bytes Map of Vector Compression, Read Under Two Rulers

A recall-vs-bytes map of vector compression from 0.01 to 200 bytes per vector across four datasets, read under two rulers: flat recall (the field's standard) and engine semantics (shortlist by code, re-rank exactly — the semantics of IVF, DiskANN, and ScaNN). At ten million items the flat ruler misreads codecs (a near-perfect codec scores 0.13 flat recall@10; 0.95 under the engine ruler). The map has structure: saturation widths that move with pool size (16B at 1M, 75B at 10M), a naming bound at log2(N) bytes below which codes filter rather than describe, and a tiny-code zone at 10M scale where a plain per-dimension codec beat Google's published RSLM reference in 10 of 11 byte-matched settings under the flat ruler (tie at display precision, no losses; tie-scale parity under the engine ruler). The map then designed its own engines: a twin family whose recall reproduces the map to within 3e-4 across five platforms from a watch to a cloud VM. At 100M vectors: 12.5 bytes retrieves 0.076, 25 bytes retrieves 0.905. Ten map cells were pre-registered under hash-witnessed commitment: seven landed in their locked intervals, two soft falsifications, one hard. Companion to the Yellow Phoenix trilogy (edge, cascade, watch, Mac-class papers).

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-11-03
DOI
https://doi.org/10.5281/zenodo.23920187
Citations
1
Primary Topic
Advanced Image and Video Retrieval Techniques
Type
article
Field-Weighted Citation Impact
2.15
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Flat Recall Is a Lottery at Ten Million Vectors — A Recall-vs-Bytes Map of Vector Compression, Read Under Two Rulers

Marc John Sawyer
1 citations
Zenodo (CERN European Organization for Nuclear Research)
Advanced Image and Video Retrieval Techniques
2.15
article

Flat Recall Is a Lottery at Ten Million Vectors — A Recall-vs-Bytes Map of Vector Compression, Read Under Two Rulers

Marc John Sawyer
article en
1 citations

Abstract

A recall-vs-bytes map of vector compression from 0.01 to 200 bytes per vector across four datasets, read under two rulers: flat recall (the field's standard) and engine semantics (shortlist by code, re-rank exactly — the semantics of IVF, DiskANN, and ScaNN). At ten million items the flat ruler misreads codecs (a near-perfect codec scores 0.13 flat recall@10; 0.95 under the engine ruler). The map has structure: saturation widths that move with pool size (16B at 1M, 75B at 10M), a naming bound at log2(N) bytes below which codes filter rather than describe, and a tiny-code zone at 10M scale where a plain per-dimension codec beat Google's published RSLM reference in 10 of 11 byte-matched settings under the flat ruler (tie at display precision, no losses; tie-scale parity under the engine ruler). The map then designed its own engines: a twin family whose recall reproduces the map to within 3e-4 across five platforms from a watch to a cloud VM. At 100M vectors: 12.5 bytes retrieves 0.076, 25 bytes retrieves 0.905. Ten map cells were pre-registered under hash-witnessed commitment: seven landed in their locked intervals, two soft falsifications, one hard. Companion to the Yellow Phoenix trilogy (edge, cascade, watch, Mac-class papers).

Zenodo (CERN European Organization for Nuclear Research)
Openalex Percentile: Top 8%
Advanced Image and Video Retrieval Techniques
2.15
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon