Simplicity and Complexity in Combinatorial Optimization
Many problems in physics and computer science can be framed in terms of combinatorial optimization. Due to this, it is interesting and important to study theoretical aspects of such optimization. Here, we study connections between Kolmogorov complexity, optima, and optimization. We argue that (1) optima and complexity are connected, with extrema being more likely to have low complexity (under certain circumstances); (2) optimization by sampling candidate solutions according to algorithmic probability may be an effective optimization method; and (3) coincidences in extrema to optimization problems are <i>a priori</i> more likely as compared to a purely random null model.
Authors
- Marcus Hutter
- Kamal Dingle
Institutions
- Australian National University (AU)
- Gulf University for Science & Technology (KW)
- Google DeepMind (United Kingdom) (GB)
- Google (United Kingdom) (GB)
Publication Details
- Journal
- Entropy
- Published
- 2026-02-15
- DOI
- https://doi.org/10.3390/e28020226
- Primary Topic
- Computability, Logic, AI Algorithms
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- California Institute of Technology
- Division of Mathematical Sciences