arXiv++ Combinatorics

We study the loss landscape of both shallow and deep, mildly overparameterized ReLU neural networks on a generic finite input dataset for the squared error loss. We show both by count and volume that most activation patterns correspond to parameter regions with no bad local minima. Furthermore, for one-dimensional input data, we show most activation regions realizable by the network contain a high dimensional set of global minima and no bad local minima. We experimentally confirm these results by finding a phase transition from most regions having full rank Jacobian to many regions having deficient rank depending on the amount of overparameterization.

We introduce new methods to describe admissible states of the six-vertex and the eight-vertex lattice models of statistical mechanics. For the six-vertex model, we view the admissible states as differential forms on a grid graph. This yields a new proof of the correspondence between admissible states and 3-colorings of a rectangular grid. For the eight-vertex model, we interpret the set of admissible states as an $\mathbb{F}_2$-vector space. This viewpoint lets us enumerate the set of admissible states. Finally, we find necessary conditions for a Yang-Baxter equation to hold for the general eight-vertex model.

Let p(n, k) denote the number of partitions of n into parts less than or equal to k. We show several properties of this function modulo 2. First, we prove that for fixed positive integers k and m, p(n,k) is periodic modulo m. Using this, we are able to find lower and upper bounds for the number of odd values of the function for a fixed k.