Novel Chain Rules for One-Shot Entropic Quantities via Operational Methods

We introduce a new operational technique for deriving chain rules for general information theoretic quantities. This technique is very different from the popular (and in some cases, fairly involved) methods like SDP formulation and operator algebra or norm interpolation. Instead, our framework considers a simple information transmission task and obtains lower and upper bounds for it. The lower bounds are obtained by leveraging a successive cancellation encoding and decoding technique. Pitting the upper and lower bounds against each other gives us the desired chain rule. As a demonstration of this technique, we derive a chain rule for the smooth-Hypothesis testing mutual information.

Authors

Institutions

Publication Details

Journal
IEEE Transactions on Information Theory
Published
2025-06-09
DOI
https://doi.org/10.1109/tit.2025.3578277
Primary Topic
Statistical Mechanics and Entropy
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Novel Chain Rules for One-Shot Entropic Quantities via Operational Methods

Upendra Kapshikar, Sayantan Chakraborty
IEEE Transactions on Information Theory
Statistical Mechanics and Entropy
article

Novel Chain Rules for One-Shot Entropic Quantities via Operational Methods

Upendra Kapshikar, Sayantan Chakraborty
article en

Abstract

We introduce a new operational technique for deriving chain rules for general information theoretic quantities. This technique is very different from the popular (and in some cases, fairly involved) methods like SDP formulation and operator algebra or norm interpolation. Instead, our framework considers a simple information transmission task and obtains lower and upper bounds for it. The lower bounds are obtained by leveraging a successive cancellation encoding and decoding technique. Pitting the upper and lower bounds against each other gives us the desired chain rule. As a demonstration of this technique, we derive a chain rule for the smooth-Hypothesis testing mutual information.

IEEE Transactions on Information TheoryVol. 71(9)
University of Ottawa (CA), Quantum Applied Science and Research (United States) (US), Département d'Informatique (FR)
Openalex Percentile: Top 89%
Statistical Mechanics and Entropy
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Novel Chain Rules for One-Shot Entropic Quantities via Operational Methods — Upendra Kapshikar, Sayantan Chakraborty · IEEE Transactions on Information Theory (2025) | TGRS Research Map | TGRS