Maximum Entropy and Bayesian Conditioning Under Extended Space

This paper examines the conditions under which Bayesian conditioning aligns with Maximum Entropy.Specifically, I address cases in which newly learned information does not correspond to an event in the probability space defined on the sample space of outcomes.To facilitate Bayesian conditioning in such cases, one must therefore extend the probability space so that the new information becomes an event in this expanded space.Skyrms (1985) argues that Bayesian conditioning in an extended probability space on a product space of outcomes aligns precisely with the solution from Maximum Entropy.In contrast, Seidenfeld (1986) uses Friedman and Shimony's (1971) result to criticize Skyrms' approach as trivial, suggesting that alignment holds only under a degenerate probability model.Here, I argue that Friedman and Shimony's result must either (1) be a benign consequence of Skyrms' approach, or (2) pose a universal challenge to any method of extending spaces.Accepting (2) would imply that Bayesian conditioning is incapable of accommodating information beyond the probability space defined on the original outcome space.

Authors

Institutions

Publication Details

Journal
Electronic Proceedings in Theoretical Computer Science
Published
2025-11-25
DOI
https://doi.org/10.4204/eptcs.437.12
Primary Topic
Epistemology, Ethics, and Metaphysics
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Maximum Entropy and Bayesian Conditioning Under Extended Space

Boning Yu
Electronic Proceedings in Theoretical Computer Science
Epistemology, Ethics, and Metaphysics
article

Maximum Entropy and Bayesian Conditioning Under Extended Space

Boning Yu
article en

Abstract

This paper examines the conditions under which Bayesian conditioning aligns with Maximum Entropy.Specifically, I address cases in which newly learned information does not correspond to an event in the probability space defined on the sample space of outcomes.To facilitate Bayesian conditioning in such cases, one must therefore extend the probability space so that the new information becomes an event in this expanded space.Skyrms (1985) argues that Bayesian conditioning in an extended probability space on a product space of outcomes aligns precisely with the solution from Maximum Entropy.In contrast, Seidenfeld (1986) uses Friedman and Shimony's (1971) result to criticize Skyrms' approach as trivial, suggesting that alignment holds only under a degenerate probability model.Here, I argue that Friedman and Shimony's result must either (1) be a benign consequence of Skyrms' approach, or (2) pose a universal challenge to any method of extending spaces.Accepting (2) would imply that Bayesian conditioning is incapable of accommodating information beyond the probability space defined on the original outcome space.

Electronic Proceedings in Theoretical Computer ScienceVol. 437
University of Maryland, College Park (US)
Openalex Percentile: Top 67%
Epistemology, Ethics, and Metaphysics
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.