Entropy estimation for partially accessible Markov networks based on imperfect observations: Role of finite resolution and finite statistics

Estimating entropy production from real observation data can be difficult due to finite resolution in both space and time and finite measurement statistics. We characterize the statistical error introduced by finite sample size and compare the performance of three different entropy estimators under these limitations for two different paradigmatic systems, a four-state Markov network and an augmented Michaelis-Menten reaction scheme. We consider the thermodynamic uncertainty relation, a waiting-time-based estimator for resolved transitions and a waiting-time-based estimator for blurred transitions in imperfect observation scenarios. For perfect measurement statistics and finite temporal resolution, the estimator based on resolved transitions performs best in all considered scenarios. The thermodynamic uncertainty relation gives a better estimate than the estimator based on blurred transitions at low driving affinities, whereas the latter performs better at high driving affinities. Furthermore, we find that a higher temporal and spatial resolution leads to slower convergence of measurement statistics, implying that for short measurement times, a lower resolution may be beneficial. Additionally, we identify a self-averaging effect for the waiting-time-based entropy estimators that can reduce their variance for observations with finite statistics.

Authors

Institutions

Publication Details

Journal
Physical review. E
Published
2025-04-07
DOI
https://doi.org/10.1103/physreve.111.044106
Citations
4
Primary Topic
Advanced Thermodynamics and Statistical Mechanics
Type
article
Field-Weighted Citation Impact
5.29
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Entropy estimation for partially accessible Markov networks based on imperfect observations: Role of finite resolution and finite statistics

Benjamin Ertel, Udo Seifert, Jonas H. Fritz
4 citations
Physical review. E
Advanced Thermodynamics and Statistical Mechanics
5.29
article

Entropy estimation for partially accessible Markov networks based on imperfect observations: Role of finite resolution and finite statistics

Benjamin Ertel, Udo Seifert, Jonas H. Fritz
article en
4 citations

Abstract

Estimating entropy production from real observation data can be difficult due to finite resolution in both space and time and finite measurement statistics. We characterize the statistical error introduced by finite sample size and compare the performance of three different entropy estimators under these limitations for two different paradigmatic systems, a four-state Markov network and an augmented Michaelis-Menten reaction scheme. We consider the thermodynamic uncertainty relation, a waiting-time-based estimator for resolved transitions and a waiting-time-based estimator for blurred transitions in imperfect observation scenarios. For perfect measurement statistics and finite temporal resolution, the estimator based on resolved transitions performs best in all considered scenarios. The thermodynamic uncertainty relation gives a better estimate than the estimator based on blurred transitions at low driving affinities, whereas the latter performs better at high driving affinities. Furthermore, we find that a higher temporal and spatial resolution leads to slower convergence of measurement statistics, implying that for short measurement times, a lower resolution may be beneficial. Additionally, we identify a self-averaging effect for the waiting-time-based entropy estimators that can reduce their variance for observations with finite statistics.

Physical review. EVol. 111(4)
University of Stuttgart (DE)
Openalex Percentile: Top 5%
Advanced Thermodynamics and Statistical Mechanics
5.29
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.