Average-case matrix discrepancy: satisfiability bounds

Given a sequence of $d \times d$ symmetric matrices $\{\mathbf{W}_i\}_{i=1}^n$, and a margin $Δ> 0$, we investigate whether it is possible to find signs $(ε_1, \dots, ε_n) \in \{\pm 1\}^n$ such that the operator norm of the signed sum satisfies $\|\sum_{i=1}^n ε_i \mathbf{W}_i\|_\mathrm{op} \leq Δ$. Kunisky and Zhang (2023) recently introduced a random version of this problem, where the matrices $\{\mathbf{W}_i\}_{i=1}^n$ are drawn from the Gaussian orthogonal ensemble. This model can be seen as a random variant of the celebrated Matrix Spencer conjecture and as a matrix-valued analog of the symmetric binary perceptron in statistical physics. In this work, we establish a satisfiability transition in this problem as $n, d \to \infty$ with $n / d^2 \to τ> 0$. Our contributions are twofold. First, we prove that the expected number of solutions with margin $Δ=κ\sqrt{n}$ has a sharp threshold at a critical $τ_1(κ)$: for $τ< τ_1(κ)$ the problem is typically unsatisfiable, while for $τ> τ_1(κ)$ the average number of solutions becomes exponentially large. Second, combining a second-moment method with recent results from Altschuler (2023) on margin concentration in perceptron-type problems, we identify a second threshold $τ_2(κ)$, such that for $τ>τ_2(κ)$ the problem admits solutions with high probability. In particular, we establish for the first time that a system of $n = Θ(d^2)$ Gaussian random matrices can be balanced so that the spectrum of the resulting matrix macroscopically shrinks compared to the typical semicircle law. Our proofs rely on deriving concentration inequalities and large deviation properties for the law of correlated Gaussian matrices under spectral norm constraints, extending results in the literature and offering insights of independent interest.

Publication Details

Journal
Repository for Publications and Research Data (ETH Zurich)
Published
2024-10-23
DOI
https://doi.org/10.3929/ethz-b-000707060
Primary Topic
Species Distribution and Climate Change
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Average-case matrix discrepancy: satisfiability bounds

Repository for Publications and Research Data (ETH Zurich)
Species Distribution and Climate Change
article

Average-case matrix discrepancy: satisfiability bounds

article en

Abstract

Given a sequence of $d \times d$ symmetric matrices $\{\mathbf{W}_i\}_{i=1}^n$, and a margin $Δ> 0$, we investigate whether it is possible to find signs $(ε_1, \dots, ε_n) \in \{\pm 1\}^n$ such that the operator norm of the signed sum satisfies $\|\sum_{i=1}^n ε_i \mathbf{W}_i\|_\mathrm{op} \leq Δ$. Kunisky and Zhang (2023) recently introduced a random version of this problem, where the matrices $\{\mathbf{W}_i\}_{i=1}^n$ are drawn from the Gaussian orthogonal ensemble. This model can be seen as a random variant of the celebrated Matrix Spencer conjecture and as a matrix-valued analog of the symmetric binary perceptron in statistical physics. In this work, we establish a satisfiability transition in this problem as $n, d \to \infty$ with $n / d^2 \to τ> 0$. Our contributions are twofold. First, we prove that the expected number of solutions with margin $Δ=κ\sqrt{n}$ has a sharp threshold at a critical $τ_1(κ)$: for $τ< τ_1(κ)$ the problem is typically unsatisfiable, while for $τ> τ_1(κ)$ the average number of solutions becomes exponentially large. Second, combining a second-moment method with recent results from Altschuler (2023) on margin concentration in perceptron-type problems, we identify a second threshold $τ_2(κ)$, such that for $τ>τ_2(κ)$ the problem admits solutions with high probability. In particular, we establish for the first time that a system of $n = Θ(d^2)$ Gaussian random matrices can be balanced so that the spectrum of the resulting matrix macroscopically shrinks compared to the typical semicircle law. Our proofs rely on deriving concentration inequalities and large deviation properties for the law of correlated Gaussian matrices under spectral norm constraints, extending results in the literature and offering insights of independent interest.

Repository for Publications and Research Data (ETH Zurich)
Peace, Justice and strong institutions
Openalex Percentile: Top 60%
Species Distribution and Climate Change
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.