Semantic Identity Compression: Zero-Error Laws, Rate-Distortion, and Neurosymbolic Necessity

When a semantic representation maps distinct identities to the same value, exact recovery requires auxiliary information. For a finite class set C and representation map π, the largest collision fiber A_π = maxᵤ|π⁻¹(u)| governs that cost. Because U = π(C) is determined by the encoder's input, this is the encoder-informed branch of Witsenhausen's zero-error side-information problem. On the induced cluster graph, the classical fixed-length law gives the one-shot budget ⌈log₂A_π⌉ and exact finite-block scaling; conditional prefix coding gives the pointwise budget ⌈log₂|π⁻¹(u)|⌉. Beyond these classical specializations, optimal recoverable mass decomposes exactly across fibers for arbitrary finite sources. A fixed family of binary queries has minimum size d ≥ ⌈log₂A_π⌉, while adaptive depth can be strictly smaller. Inclusion-minimal distinguishing families are the bases of a matroid exactly when distinguishing is the corresponding spanning predicate; orthogonality alone fails by a finite counterexample. Collision-freedom is unstable under open-world extension, and barrier-freedom is uncomputable for arbitrary future-generating code. Bits, queries, and distortion are three currencies for the same residual ambiguity; symbolic handles supply the missing identity information. Lean 4 checks the cited finite coding laws, query criteria, counterexamples, and reduction cores.

Authors

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-07-27
DOI
https://doi.org/10.5281/zenodo.21631553
Primary Topic
Algorithms and Data Compression
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Semantic Identity Compression: Zero-Error Laws, Rate-Distortion, and Neurosymbolic Necessity

Tristan Simas
Zenodo (CERN European Organization for Nuclear Research)
Algorithms and Data Compression
article

Semantic Identity Compression: Zero-Error Laws, Rate-Distortion, and Neurosymbolic Necessity

Tristan Simas
article en

Abstract

When a semantic representation maps distinct identities to the same value, exact recovery requires auxiliary information. For a finite class set C and representation map π, the largest collision fiber A_π = maxᵤ|π⁻¹(u)| governs that cost. Because U = π(C) is determined by the encoder's input, this is the encoder-informed branch of Witsenhausen's zero-error side-information problem. On the induced cluster graph, the classical fixed-length law gives the one-shot budget ⌈log₂A_π⌉ and exact finite-block scaling; conditional prefix coding gives the pointwise budget ⌈log₂|π⁻¹(u)|⌉. Beyond these classical specializations, optimal recoverable mass decomposes exactly across fibers for arbitrary finite sources. A fixed family of binary queries has minimum size d ≥ ⌈log₂A_π⌉, while adaptive depth can be strictly smaller. Inclusion-minimal distinguishing families are the bases of a matroid exactly when distinguishing is the corresponding spanning predicate; orthogonality alone fails by a finite counterexample. Collision-freedom is unstable under open-world extension, and barrier-freedom is uncomputable for arbitrary future-generating code. Bits, queries, and distortion are three currencies for the same residual ambiguity; symbolic handles supply the missing identity information. Lean 4 checks the cited finite coding laws, query criteria, counterexamples, and reduction cores.

Zenodo (CERN European Organization for Nuclear Research)
McGill University (CA)
Reduced inequalities, Peace, Justice and strong institutions
Openalex Percentile: Top 7%
Algorithms and Data Compression
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Semantic Identity Compression: Zero-Error Laws, Rate-Distortion, and Neurosymbolic Necessity — Tristan Simas · Zenodo (CERN European Organization for Nuclear Research) (2026) | TGRS Research Map | TGRS