How Finely Should an Observation Be Recorded? Information Limits from Resolution, Noise and Quantization

How finely must an observation be recorded before further precision yields insignificant information? We address this question, raised in our previous paper (doi:10.5281/zenodo.23384047), by studying the operational score R = I(Xδ; Q)/H(Xδ) for a bounded source with descriptor resolution δ, additive noise of scale σ, and uniform recording step Δ. At every finite resolution, explicit entropy bounds identify the coarsest of these three scales as the bottleneck. The constants depend on the noise law, not the scales, and no dither is required. The lower bound requires only finite noise variance, while the matching upper bound additionally requires a noise density with finite differential entropy when the recording step is finer than the noise scale (Δ < σ). For admissible noise and sources with positive information dimension, the bounds give R → min(a, b, 1) when σ ∝ δᵃ and Δ ∝ δᵇ. For Gaussian noise, with the source, δ and σ fixed, the recording loss is (Δ²/24)[E J(Y | Xδ) − J(Y)] + O(Δ⁴), where J is Fisher information. The coefficient is an estimation-error gap, yielding a universal leading-order bound of Δ²/(24σ²) nats. Dither and information-decomposition identities connect this law to recording design. Case studies examine threshold placement, bit allocation and sampling trade-offs, while showing why predictive lower bounds can rise under coarsening. Checks use synthetic and recording-derived laws. Direct numerical tests using 2 fixed continuous source distributions showed convergence toward the predicted limits in all 8 sequences, although some converged slowly. Tests using recording-derived source distributions were less conclusive: 5 of 36 finite-resolution slope checks failed their acceptance criterion, without establishing nonconvergence of R. A speech-derived Gaussian-channel test resolves the quadratic recording loss directly, whereas heartbeat and physical replay checks have more limited scope. These computations support the analysis without establishing infinite limits or validating every instrument. The contribution is a unified finite-resolution treatment with explicit constants and stated noise assumptions. Specifically, the sandwich bounds and coupled limit build on established constant-gap and information-dimension results. Moreover, the leading fine-recording coefficient specializes classical divergence-quantization theory.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-11-01
DOI
https://doi.org/10.5281/zenodo.23852143
Primary Topic
Advanced Data Compression Techniques
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

How Finely Should an Observation Be Recorded? Information Limits from Resolution, Noise and Quantization

Kevin Leon Merdy
1 links
Zenodo (CERN European Organization for Nuclear Research)
Advanced Data Compression Techniques
preprint

How Finely Should an Observation Be Recorded? Information Limits from Resolution, Noise and Quantization

Kevin Leon Merdy
preprint en

Abstract

How finely must an observation be recorded before further precision yields insignificant information? We address this question, raised in our previous paper (doi:10.5281/zenodo.23384047), by studying the operational score R = I(Xδ; Q)/H(Xδ) for a bounded source with descriptor resolution δ, additive noise of scale σ, and uniform recording step Δ. At every finite resolution, explicit entropy bounds identify the coarsest of these three scales as the bottleneck. The constants depend on the noise law, not the scales, and no dither is required. The lower bound requires only finite noise variance, while the matching upper bound additionally requires a noise density with finite differential entropy when the recording step is finer than the noise scale (Δ < σ). For admissible noise and sources with positive information dimension, the bounds give R → min(a, b, 1) when σ ∝ δᵃ and Δ ∝ δᵇ. For Gaussian noise, with the source, δ and σ fixed, the recording loss is (Δ²/24)[E J(Y | Xδ) − J(Y)] + O(Δ⁴), where J is Fisher information. The coefficient is an estimation-error gap, yielding a universal leading-order bound of Δ²/(24σ²) nats. Dither and information-decomposition identities connect this law to recording design. Case studies examine threshold placement, bit allocation and sampling trade-offs, while showing why predictive lower bounds can rise under coarsening. Checks use synthetic and recording-derived laws. Direct numerical tests using 2 fixed continuous source distributions showed convergence toward the predicted limits in all 8 sequences, although some converged slowly. Tests using recording-derived source distributions were less conclusive: 5 of 36 finite-resolution slope checks failed their acceptance criterion, without establishing nonconvergence of R. A speech-derived Gaussian-channel test resolves the quadratic recording loss directly, whereas heartbeat and physical replay checks have more limited scope. These computations support the analysis without establishing infinite limits or validating every instrument. The contribution is a unified finite-resolution treatment with explicit constants and stated noise assumptions. Specifically, the sandwich bounds and coupled limit build on established constant-gap and information-dimension results. Moreover, the leading fine-recording coefficient specializes classical divergence-quantization theory.

Zenodo (CERN European Organization for Nuclear Research)
Advanced Data Compression Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon
How Finely Should an Observation Be Recorded? Information Limits from Resolution, Noise and Quantization — Kevin Leon Merdy · Zenodo (CERN European Organization for Nuclear Research) (2026) | TGRS Research Map | TGRS