Papers by Sumit Mukherjee
11 paper(s) by this author
· All BibTeX
Large random matrices with given margins
We study large random matrices with i.i.d. entries conditioned to have prescribed row and column sums (margins), a problem connected to relative entropy minimization, Schrödinger bridges, contingency tables, and random graphs with given degree sequences. Our central result is a `transference principle': the complex margin-conditioned matrix can be closely approximated by a simpler matrix whose entries are independent and drawn from an exponential tilting of the original model. The tilt parameters are determined by the sum of two potentials. We establish phase diagrams for `tame margins', where these potentials are uniformly bounded. This framework resolves a 2011 conjecture by Chatterjee, Diaconis, and Sly on $δ$-tame degree sequences and generalizes a sharp phase transition in contingency tables obtained by Dittmer, Lyu, and Pak in 2020. For tame margins, we show that a generalized Sinkhorn algorithm can compute the potentials at a dimension-free exponential rate. Our limit theory further establishes that for a convergent sequence of tame margins, the potentials converge as fast as the margins converge.
We apply this framework and obtain several key results for the conditioned matrix: The marginal distribution of any single entry is asymptotically an exponential tilting of the base measure, resolving a 2010 conjecture by Barvinok on contingency tables. The conditioned matrix concentrates in cut norm around a `typical table' (the expectation of the tilted model), which acts as a static Schrödinger bridge between the margins. The empirical singular value distribution of the rescaled matrix converges to an explicit law determined by the variance profile of the tilted model. In particular, we confirm the universality of the Marchenko-Pastur law for constant linear margins.
Gibbs Measures with Multilinear Forms
In this paper, we study a class of multilinear Gibbs measures with Hamiltonian given by a generalized $\mathrm{U}$-statistic and with a general base measure. Expressing the asymptotic free energy as an optimization problem over a space of functions, we obtain necessary and sufficient conditions for replica-symmetry. Utilizing this, we obtain weak limits for a large class of statistics of interest, which includes the ''local fields/magnetization'', the Hamiltonian, the global magnetization, etc. An interesting consequence is a universal weak law for contrasts under replica symmetry, namely, $n^{-1}\sum_{i=1}^n c_i X_i\to 0$ weakly, if $\sum_{i=1}^n c_i=o(n)$. Our results yield a probabilistic interpretation for the optimizers arising out of the limiting free energy. We also prove the existence of a sharp phase transition point in terms of the temperature parameter, thereby generalizing existing results that were only known for quadratic Hamiltonians. As a by-product of our proof technique, we obtain exponential concentration bounds on local and global magnetizations, which are of independent interest.
Large deviation principle for random permutations
Published
• View Publication
• BIB
We derive a large deviation principle for random permutations induced by probability measures of the unit square, called permutons. These permutations are called $μ$-random permutations. We also introduce and study a new general class of models of random permutations, called Gibbs permutation models, which combines and generalizes $μ$-random permutations and the celebrated Mallows model for permutations. Most of our results hold in the general setting of Gibbs permutation models.
We apply the tools that we develop to the case of $μ$-random permutations conditioned to have an atypical proportion of patterns. Several results are made more concrete in the specific case of inversions. For instance, we prove the existence of at least one phase transition for a generalized version of the Mallows model where the base measure is non-uniform. This is in contrast with the results of Starr (2009, 2018) on the (standard) Mallows model, where the absence of phase transition, i.e., phase uniqueness, was proven.
Our results naturally lead us to investigate a new notion of permutons, called conditionally constant permutons, which generalizes both pattern-avoiding and pattern-packing permutons. We describe some properties of conditionally constant permutons with respect to inversions. The study of conditionally constant permutons for general patterns seems to be a challenging problem.
Fluctuations of Quadratic Chaos
Published in Commun. Math. Phys. 405, 237 (2024)
• View Publication
• BIB
In this paper we characterize all distributional limits of the random quadratic form $T_n =\sum_{1\le u< v\le n} a_{u, v} X_u X_v$, where $((a_{u, v}))_{1\le u,v\le n}$ is a $\{0, 1\}$-valued symmetric matrix with zeros on the diagonal and $X_1, X_2, \ldots, X_n$ are i.i.d.~ mean $0$ variance $1$ random variables with common distribution function $F$. In particular, we show that any distributional limit of $S_n:=T_n/\sqrt{\mathrm{Var}[T_n]}$ can be expressed as the sum of three independent components: a Gaussian, a (possibly) infinite weighted sum of independent centered chi-squares, and a Gaussian mixture with a random variance. As a consequence, we prove a fourth moment theorem for the asymptotic normality of $S_n$, which applies even when $F$ does not have finite fourth moment. More formally, we show that $S_n$ converges to $N(0, 1)$ if and only if the fourth moment of $S_n$ (appropriately truncated when $F$ does not have finite fourth moment) converges to 3 (the fourth moment of the standard normal distribution).
Motif Estimation via Subgraph Sampling: The Fourth Moment Phenomenon
Published in Ann. Statist. 50(2): 987-1011 (April 2022)
• View Publication
• BIB
Network sampling is an indispensable tool for understanding features of large complex networks where it is practically impossible to search over the entire graph. In this paper, we develop a framework for statistical inference for counting network motifs, such as edges, triangles, and wedges, in the widely used subgraph sampling model, where each vertex is sampled independently, and the subgraph induced by the sampled vertices is observed. We derive necessary and sufficient conditions for the consistency and the asymptotic normality of the natural Horvitz-Thompson (HT) estimator, which can be used for constructing confidence intervals and hypothesis testing for the motif counts based on the sampled graph. In particular, we show that the asymptotic normality of the HT estimator exhibits an interesting fourth-moment phenomenon, which asserts that the HT estimator (appropriately centered and rescaled) converges in distribution to the standard normal whenever its fourth-moment converges to 3 (the fourth-moment of the standard normal distribution). As a consequence, we derive the exact thresholds for consistency and asymptotic normality of the HT estimator in various natural graph ensembles, such as sparse graphs with bounded degree, Erdos-Renyi random graphs, random regular graphs, and dense graphons.
The Second Moment Phenomenon for Monochromatic Subgraphs
Published in SIAM Journal on Discrete Mathematics, Vol. 34 (1), 794-824, 2020
• View Publication
• BIB
What is the chance that among a group of $n$ friends, there are $s$ friends all of whom have the same birthday? This is the celebrated birthday problem which can be formulated as the existence of a monochromatic $s$-clique $K_s$ ($s$-matching birthdays) in the complete graph $K_n$, where every vertex of $K_n$ is uniformly colored with $365$ colors (corresponding to birthdays). More generally, for a general connected graph $H$, let $T(H, G_n)$ be the number of monochromatic copies of $H$ in a uniformly random coloring of the vertices of the graph $G_n$ with $c_n$ colors. In this paper we show that $T(H, G_n)$ converges to $\mathrm{Pois}(λ)$ whenever $\mathbb E T(H, G_n) \rightarrow λ$ and $\mathrm{Var} T(H, G_n) \rightarrow λ$, that is, the asymptotic Poisson distribution of $T(H, G_n)$ is determined just by the convergence of its mean and variance. Moreover, this condition is necessary if and only if $H$ is a star-graph. In fact, the second-moment phenomenon is a consequence of a more general theorem about the convergence of $T(H,G_n)$ to a finite linear combination of independent Poisson random variables. As an application, we derive the limiting distribution of $T(H, G_n)$, when $G_n\sim G(n, p)$ is the Erd\H os-Rényi random graph. Multiple phase-transitions emerge as $p$ varies from 0 to 1, depending on whether the graph $H$ is balanced or unbalanced.
Monochromatic Subgraphs in Randomly Colored Graphons
Published in European Journal of Combinatorics, 81, 328-353, 2019
• View Publication
• BIB
Let $T(H, G_n)$ be the number of monochromatic copies of a fixed connected graph $H$ in a uniformly random coloring of the vertices of the graph $G_n$. In this paper we give a complete characterization of the limiting distribution of $T(H, G_n)$, when $\{G_n\}_{n \geq 1}$ is a converging sequence of dense graphs. When the number of colors grows to infinity, depending on whether the expected value remains bounded, $T(H, G_n)$ either converges to a finite linear combination of independent Poisson variables or a normal distribution. On the other hand, when the number of colors is fixed, $T(H, G_n)$ converges to a (possibly infinite) linear combination of independent centered chi-squared random variables. This generalizes the classical birthday problem, which involves understanding the asymptotics of $T(K_s, K_n)$, the number of monochromatic $s$-cliques in a complete graph $K_n$ ($s$-matching birthdays among a group of $n$ friends), to general monochromatic subgraphs in a network.
Limit Theorems for Monochromatic Stars
Published
• View Publication
• BIB
Let $T(K_{1, r}, G_n)$ be the number of monochromatic copies of the $r$-star $K_{1, r}$ in a uniformly random coloring of the vertices of the graph $G_n$. In this paper we provide a complete characterization of the limiting distribution of $T(K_{1, r}, G_n)$, in the regime where $\mathbb E(T(K_{1, r}, G_n))$ is bounded, for any growing sequence of graphs $G_n$. The asymptotic distribution is a sum of mutually independent components, each term of which is a polynomial of a single Poisson random variable of degree at most $r$. Conversely, any limiting distribution of $T(K_{1, r}, G_n)$ has a representation of this form. Examples and connections to the birthday problem are discussed.
Degree Sequence of Random Permutation Graphs
Published in Annals of Applied Probability, Vol. 27 (1), 439-484, 2017
• View Publication
• BIB
In this paper we study the degree sequence of the permutation graph $G_{π_n}$ associated with a sequence $π_n\in S_n$ of random permutations. Joint limiting distributions of the degrees are established using results from graph and permutation limit theories. In particular, for the uniform random permutation, the joint distribution of the degrees of the vertices labelled $\lceil nr_1 \rceil, \lceil nr_2 \rceil, \ldots, \lceil nr_s \rceil$ converges (after scaling by $n$) to independent random variables $D_1, D_2, \ldots, D_s$, where $D_i\sim \text{Unif}(r_i, 1-r_i)$, for $r_i\in [0,1]$ and $i\in \{1, 2, \ldots, s\}$. Moreover, the degree of the mid-vertex (the vertex labelled $n/2$) has a central limit theorem, and the minimum degree converges to a Rayleigh distribution after appropriate scalings. Finally, the limiting degree distribution of the permutation graph associated with a Mallows random permutation is determined, and interesting phase transitions are observed. Our results extend to other exponential measures on permutations.
Universal Limit Theorems in Graph Coloring Problems With Connections to Extremal Combinatorics
Published in Annals of Applied Probability, Vol. 27 (1), 337-394, 2017
• View Publication
• BIB
This paper proves limit theorems for the number of monochromatic edges in uniform random colorings of general random graphs. These can be seen as generalizations of the birthday problem (what is the chance that there are two friends with the same birthday?). It is shown that if the number of colors grows to infinity, the asymptotic distribution is either a Poisson mixture or a Normal depending solely on the limiting behavior of the ratio of the number of edges in the graph and the number of colors. This result holds for any graph sequence, deterministic or random. On the other hand, when the number of colors is fixed, a necessary and sufficient condition for asymptotic normality is determined. Finally, using some results from the emerging theory of dense graph limits, the asymptotic (non-normal) distribution is characterized for any converging sequence of dense graphs. The proofs are based on moment calculations which relate to the results of Erd\H os and Alon on extremal subgraph counts. As a consequence, a simpler proof of a result of Alon, estimating the number of isomorphic copies of a cycle of given length in graphs with a fixed number of edges, is presented.
Exact and Asymptotic Results on Coarse Ricci Curvature of Graphs
Published
• View Publication
• BIB
Ricci curvature was proposed by Ollivier in a general framework of metric measure spaces, and it has been studied extensively in the context of graphs in recent years. In this paper we prove upper bounds for Ollivier's Ricci curvature for bipartite graphs and for the graphs with girth at least 5. We also prove a general lower bound on the Ricci curvature in terms of the size of the maximum matching in an appropriate subgraph. As a consequence, we characterize the Ricci-flat graphs of girth 5. Moreover, using our general lower bound and the Birkhoff-von Neumann theorem, we give a necessary and sufficient condition for the structure of Ricci-flat regular graphs of girth 4. Finally, we obtain the asymptotic Ricci curvature of random bipartite graphs $G(n,n, p)$ and random graphs $G(n, p)$, in various regimes of $p$.