arXiv++ Combinatorics

We derive a sufficient condition for a sparse random matrix with given numbers of non-zero entries in the rows and columns having full row rank. The result covers both matrices over finite fields with independent non-zero entries and $\{0,1\}$-matrices over the rationals. The sufficient condition is generally necessary as well.

Warning Propagation is a combinatorial message passing algorithm that unifies and generalises a wide variety of recursive combinatorial procedures. Special cases include the Unit Clause Propagation and Pure Literal algorithms for satisfiability as well as the peeling process for identifying the $k$-core of a random graph. Here we analyse Warning Propagation in full generality on a very general class of multi-type random graphs. We prove that under mild assumptions on the random graph model and the stability of the the message limit, Warning Propagation converges rapidly. In effect, the analysis of the fixed point of the message passing process on a random graph reduces to analysing the process on a multi-type Galton-Watson tree. This result corroborates and generalises a heuristic first put forward by Pittel, Spencer and Wormald in their seminal $k$-core paper (JCTB 1996).

Let $\mathbf{A}$ be an $n\times n$-matrix over $\mathbb{F}_2$ whose every entry equals $1$ with probability $d/n$ independently for a fixed $d>0$. Draw a vector $\mathbf{y}$ randomly from the column space of $\mathbf{A}$. It is a simple observation that the entries of a random solution $\mathbf{x}$ to $\mathbf{A} x=\mathbf{y}$ are asymptotically pairwise independent, i.e., $\sum_{i<j}\mathbb{E}|\mathbb{P}[\mathbf{x}_i=s,\,\mathbf{x}_j=t\mid\mathbf{A}]-\mathbb{P}[\mathbf{x}_i=s\mid\mathbf{A}]\mathbb{P}[\mathbf{x}_j=t\mid\mathbf{A}]|=o(n^2)$ for $s,t\in\mathbb{F}_2$. But what can we say about the {\em overlap} of two random solutions $\mathbf{x},\mathbf{x}'$, defined as $n^{-1}\sum_{i=1}^n\mathbf{1}\{\mathbf{x}_i=\mathbf{x}_i'\}$? We prove that for $d<\mathrm{e}$ the overlap concentrates on a single deterministic value $α_*(d)$. By contrast, for $d>\mathrm{e}$ the overlap concentrates on a single value once we condition on the matrix $\mathbf{A}$, while over the probability space of $\mathbf{A}$ its conditional expectation vacillates between two different values $α_*(d)<α^*(d)$, either of which occurs with probability $1/2+o(1)$. This bifurcated non-concentration result provides an instructive contribution to both the theory of random constraint satisfaction problems and of inference problems on random structures.

Warning Propagation is a combinatorial message passing algorithm that unifies and generalises a wide variety of recursive combinatorial procedures. Special cases include the Unit Clause Propagation and Pure Literal algorithms for satisfiability as well as the peeling process for identifying the $k$-core of a random graph. Here we analyse Warning Propagation in full generality on the binomial random graph. We prove that under a mild stability assumption Warning Propagation converges rapidly. In effect, the analysis of the fixed point of the message passing process on a random graph reduces to analysing the process on a Galton-Watson tree. This result corroborates and generalises a heuristic first put forward by Pittel, Spencer and Wormald in their seminal $k$-core paper (JCTB 1996).

We show that throughout the satisfiable phase the normalised number of satisfying assignments of a random $2$-SAT formula converges in probability to an expression predicted by the cavity method from statistical physics. The proof is based on showing that the Belief Propagation algorithm renders the correct marginal probability that a variable is set to `true' under a uniformly random satisfying assignment.