Decomposing multivariate information rates in networks of random processes

The partial information decomposition (PID) framework has emerged as a powerful tool for analyzing high-order interdependencies in complex network systems. However, its application to dynamic processes remains challenging due to the implicit assumption of memorylessness, which often falls in real-world scenarios. In this work, we introduce the framework of partial information rate decomposition (PIRD) that extends PID to random processes with temporal correlations. By leveraging mutual information rate instead of mutual information (MI), our approach decomposes the dynamic information shared by multivariate random processes into unique, redundant, and synergistic contributions obtained aggregating information rate atoms in a principled manner. To concretely implement this idea, we define a pointwise redundancy rate function based on the minimum MI principle applied locally in the frequency-domain representation of the processes. The framework is validated in benchmark simulations of Gaussian systems, demonstrating its advantages over traditional PID in capturing temporal correlations and showing how the spectral representation may reveal scale-specific higher-order interactions that are obscured in the time domain. Furthermore, we apply PIRD to a physiological network comprising cerebrovascular and cardiovascular variables, revealing frequency-dependent redundant information exchange during a protocol of postural stress. Our results highlight the necessity of accounting for the full temporal statistical structure and spectral content of vector random processes to meaningfully perform information decomposition in network systems with dynamic behavior such as those typically encountered in neuroscience and physiology.

Authors

Institutions

Publication Details

Journal
Physical review. E
Published
2025-10-01
DOI
https://doi.org/10.1103/mn8p-kf6t
Citations
2
Primary Topic
Functional Brain Connectivity Studies
Type
article
Field-Weighted Citation Impact
2.86
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Decomposing multivariate information rates in networks of random processes

Yuri Antonacci, Gorana Mijatović, Laura Sparacino, Luca Faes et al.
2 citations
Physical review. E
Functional Brain Connectivity Studies
2.86
article

Decomposing multivariate information rates in networks of random processes

Yuri Antonacci, Gorana Mijatović, Laura Sparacino, Luca Faes, Daniele Marinazzo, Leonardo Ricci, Sebastiano Stramaglia
article en
2 citations

Abstract

The partial information decomposition (PID) framework has emerged as a powerful tool for analyzing high-order interdependencies in complex network systems. However, its application to dynamic processes remains challenging due to the implicit assumption of memorylessness, which often falls in real-world scenarios. In this work, we introduce the framework of partial information rate decomposition (PIRD) that extends PID to random processes with temporal correlations. By leveraging mutual information rate instead of mutual information (MI), our approach decomposes the dynamic information shared by multivariate random processes into unique, redundant, and synergistic contributions obtained aggregating information rate atoms in a principled manner. To concretely implement this idea, we define a pointwise redundancy rate function based on the minimum MI principle applied locally in the frequency-domain representation of the processes. The framework is validated in benchmark simulations of Gaussian systems, demonstrating its advantages over traditional PID in capturing temporal correlations and showing how the spectral representation may reveal scale-specific higher-order interactions that are obscured in the time domain. Furthermore, we apply PIRD to a physiological network comprising cerebrovascular and cardiovascular variables, revealing frequency-dependent redundant information exchange during a protocol of postural stress. Our results highlight the necessity of accounting for the full temporal statistical structure and spectral content of vector random processes to meaningfully perform information decomposition in network systems with dynamic behavior such as those typically encountered in neuroscience and physiology.

Physical review. EVol. 112(4)
Istituto Nazionale di Fisica Nucleare (IT), University of Novi Sad (RS), University of Trento (IT), Ghent University (BE), Istituto Nazionale di Fisica Nucleare, Sezione di Bari (IT), University of Bari Aldo Moro (IT), University of Palermo (IT)
Openalex Percentile: Top 8%
Functional Brain Connectivity Studies
2.86
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.