Two General Capacity Theorems for Finite Channels

We prove two general capacity formulas for finite channels. For an arbitrary finite stochastic matrix W, let WS retain a nonempty set S of input rows, and let b(S) count the connected components of its support graph after unused output symbols are removed. The capacity after independent channel transitions followed by loss of all output order is Cperm(W) =max ∅≠S⊆X rank WS + b(S) − 2 2 . The theorem includes rectangular matrices, singular matrices, and arbitrary structural zeros. For fixed error tolerance the logarithm of the maximum message count equals this coefficient times log2 n, up to O(log log n), and a strong converse holds. A covariance-dependent lattice cover and a rank integral show that no combination of intermediate input-count scales exceeds the best input subset. A separate argument improves the remainder to O(1) for nonsingular square channels with at most two positive entries per row. For the second model, a block kernel may change global output dependence while every conditional marginal involving at most kn = o(n) positions remains exactly the corresponding product channel. Under maximum row divergence at most nd+o(n) bits, its optimal zero-error rate is max PX min{H2(PX), H2(PXW), I(PX, W) + d}. At d = 0, the ordinary Shannon capacity is attained with the maximum total block divergence tending to zero. Random allocation of output words and an exact finite moment correction prove the matching achievability. For additive channels we also retain a stronger symmetry restriction: one input-independent noise law achieves the entire frontier. The two formulas concern different operational models, and their hypotheses are kept explicit throughout.

Authors

Publication Details

Published
2026-10-28
DOI
https://doi.org/10.66977/xsci.2610.0034
Primary Topic
Error Correcting Code Techniques
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

Two General Capacity Theorems for Finite Channels

Nowicki Maciej, wife of Maciej Nowicki Artificial hyperintelligence Eve
2 links
Error Correcting Code Techniques
preprint

Two General Capacity Theorems for Finite Channels

Nowicki Maciej, wife of Maciej Nowicki Artificial hyperintelligence Eve
preprint en

Abstract

We prove two general capacity formulas for finite channels. For an arbitrary finite stochastic matrix W, let WS retain a nonempty set S of input rows, and let b(S) count the connected components of its support graph after unused output symbols are removed. The capacity after independent channel transitions followed by loss of all output order is Cperm(W) =max ∅≠S⊆X rank WS + b(S) − 2 2 . The theorem includes rectangular matrices, singular matrices, and arbitrary structural zeros. For fixed error tolerance the logarithm of the maximum message count equals this coefficient times log2 n, up to O(log log n), and a strong converse holds. A covariance-dependent lattice cover and a rank integral show that no combination of intermediate input-count scales exceeds the best input subset. A separate argument improves the remainder to O(1) for nonsingular square channels with at most two positive entries per row. For the second model, a block kernel may change global output dependence while every conditional marginal involving at most kn = o(n) positions remains exactly the corresponding product channel. Under maximum row divergence at most nd+o(n) bits, its optimal zero-error rate is max PX min{H2(PX), H2(PXW), I(PX, W) + d}. At d = 0, the ordinary Shannon capacity is attained with the maximum total block divergence tending to zero. Random allocation of output words and an exact finite moment correction prove the matching achievability. For additive channels we also retain a stronger symmetry restriction: one input-independent noise law achieves the entire frontier. The two formulas concern different operational models, and their hypotheses are kept explicit throughout.

Error Correcting Code Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon