Papers by Shirshendu Ganguly
24 paper(s) by this author
· All BibTeX
Decoupling of clusters in independent sets in a percolated hypercube
Independent sets in graphs are sets of vertices containing no neighbors, and they represent a canonical spin system with hardcore constraints. Of particular interest is the setting of the boolean hypercube, where counting independent sets was the original motivator for Sapozhenko's famous graph container method. A modern perspective on such problems is to consider the effect of disorder, and the study of independent sets in random subgraphs of the hypercube obtained via bond percolation with parameter $p$ was initiated by Kronenberg and Spinka. They employed tools from statistical mechanics to obtain detailed information about the moments of the number of independent sets (now a random variable), and posed many interesting questions. Previous work by the authors addressed many of these questions in the regime $p \geq \frac{2}{3}$, where the behavior is relatively simple and can be modeled well by a related family of independent particles.
As $p$ decreases, though, typical independent sets become larger and feature more intricate clustering behavior. In the present article we overcome many of the challenges presented by this phenomenon and analyze the model for all $p> 0.465$. We obtain a sharp in-probability approximation for the number of independent sets in the percolated hypercube in terms of explicit random variables, as well as provide a sampling algorithm. Note that this shows, curiously, that $p = \frac{1}{2}$ is not a natural barrier for this problem unlike in many other problems where it appears as a point of a phase transition. A key contribution of this work is the introduction of a new probabilistic framework to handle the clustering behavior for these low values of $p$. Although our analysis is restricted to $p > 0.465$, our arguments are expected to be helpful for studying this model at even lower values of $p$, and possibly for other related problems.
Gaussian to log-normal transition for independent sets in a percolated hypercube
Independent sets in graphs, i.e., subsets of vertices where no two are adjacent, have long been studied, for instance as a model of hard-core gas. The $d$-dimensional hypercube, $\{0,1\}^d$, with the nearest neighbor structure, has been a particularly appealing choice for the base graph, owing in part to its many symmetries. Results go back to the work of Korshunov and Sapozhenko who proved sharp results on the count of such sets as well as structure theorems for random samples drawn uniformly. Of much interest is the behavior of such Gibbs measures in the presence of disorder. In this direction, Kronenberg and Spinka [KS] initiated the study of independent sets in a random subgraph of the hypercube obtained by considering an instance of bond percolation with probability $p$. Relying on tools from statistical mechanics they obtained a detailed understanding of the moments of the partition function, say $\mathcal{Z}$, of the hard-core model on such random graphs and consequently deduced certain fluctuation information, as well as posed a series of interesting questions. In particular, they showed in the uniform case that there is a natural phase transition at $p=2/3$ where $\mathcal{Z}$ transitions from being concentrated for $p>2/3$ to not concentrated at $p=2/3$.
In this article, developing a probabilistic framework, as well as relying on certain cluster expansion inputs from [KS], we present a detailed picture of both the fluctuations of $\mathcal{Z}$ as well as the geometry of a randomly sampled independent set. In particular, we establish that $\mathcal{Z}$, properly centered and scaled, converges to a standard Gaussian for $p>2/3$, and to a sum of two i.i.d. log-normals at $p=2/3$. A particular step in the proof which could be of independent interest involves a non-uniform birthday problem for which collisions emerge at $p=2/3$.
Spectral large deviations of sparse random matrices
Published
• View Publication
• BIB
Eigenvalues of Wigner matrices has been a major topic of investigation. A particularly important subclass of such random matrices is formed by the adjacency matrix of an Erdős-Rényi graph $\mathcal{G}_{n,p}$ equipped with i.i.d. edge-weights. An observable of particular interest is the largest eigenvalue. In this paper, we study the large deviations behavior of the largest eigenvalue of such matrices, a topic that has received considerable attention over the years. We focus on the case $p = \frac{d}{n}$, where most known techniques break down. So far, results were known only for $\mathcal{G}_{n,\frac{d}{n}}$ without edge-weights (Krivelevich and Sudakov, '03), (Bhattacharya, Bhattacharya, and Ganguly, '21) and with Gaussian edge-weights (Ganguly and Nam, '21).
In the present article, we consider the effect of general weight distributions. More specifically, we consider the entries whose tail probabilities decay at rate $e^{-t^α}$ with $α>0$, where the regimes $0<α<2$ and $α>2$ correspond to tails heavier and lighter than the Gaussian tail respectively. While in many natural settings the large deviations behavior is expected to depend crucially on the entry distribution, we establish a surprising and rare universal behavior showing that this is not the case when $α> 2.$ In contrast, in the $α< 2$ case, the large deviation rate function is no longer universal and is given by the solution to a variational problem, the description of which involves a generalization of the Motzkin-Straus theorem, a classical result from spectral graph theory.
As a byproduct of our large deviation results, we also establish new law of large numbers results for the largest eigenvalue. In particular, we show that the typical value of the largest eigenvalue exhibits a phase transition at $α= 2$, i.e. the Gaussian distribution.
Upper tail behavior of the number of triangles in random graphs with constant average degree
Published
• View Publication
• BIB
Let $N$ be the number of triangles in an Erdős-Rényi graph $\mathcal{G}(n,p)$ on $n$ vertices with edge density $p=d/n,$ where $d>0$ is a fixed constant. It is well known that $N$ weakly converges to the Poisson distribution with mean ${d^3}/{6}$ as $n\rightarrow \infty$. We address the upper tail problem for $N,$ namely, we investigate how fast $k$ must grow, so that the probability of $\{N\ge k\}$ is not well approximated anymore by the tail of the corresponding Poisson variable. Proving that the tail exhibits a sharp phase transition, we essentially show that the upper tail is governed by Poisson behavior only when $k^{1/3} \log k< (\frac{3}{\sqrt{2}})^{2/3} \log n$ (sub-critical regime) as well as pin down the tail behavior when $k^{1/3} \log k> (\frac{3}{\sqrt{2}})^{2/3} \log n$ (super-critical regime). We further prove a structure theorem, showing that the sub-critical upper tail behavior is dictated by the appearance of almost $k$ vertex-disjoint triangles whereas in the supercritical regime, the excess triangles arise from a clique like structure of size approximately $(6k)^{1/3}$. This settles the long-standing upper-tail problem in this case, answering a question of Aldous, complementing a long sequence of works, spanning multiple decades, culminating in (Harel, Moussat, Samotij,'19) which analyzed the problem only in the regime $p\gg \frac{1}{n}.$ The proofs rely on several novel graph theoretical results which could have other applications.
Many nodal domains in random regular graphs
Published
• View Publication
• BIB
Let $G$ be a random $d$-regular graph. We prove that for every constant $α> 0$, with high probability every eigenvector of the adjacency matrix of $G$ with eigenvalue less than $-2\sqrt{d-2}-α$ has $Ω(n/$polylog$(n))$ nodal domains.
Large deviations for the largest eigenvalue of Gaussian networks with constant average degree
Published
• View Publication
• BIB
Large deviation behavior of the largest eigenvalue $λ_1$ of Gaussian networks (Erdős-Rényi random graphs $\mathcal{G}_{n,p}$ with i.i.d. Gaussian weights on the edges) has been the topic of considerable interest. Recently in [6,30], a powerful approach was introduced based on tilting measures by suitable spherical integrals, particularly establishing a non-universal large deviation behavior for fixed $p<1$ compared to the standard Gaussian ($p=1$) case. The case when $p\to 0$ was however completely left open with one expecting the dense behavior to hold only until the average degree is logarithmic in $n$. In this article we focus on the case of constant average degree i.e., $p=\frac{d}{n}$. We prove the following results towards a precise understanding of the large deviation behavior in this setting.
1. (Upper tail probabilities): For $δ>0,$ we pin down the exact exponent $ψ(δ)$ such that $$\mathbb{P}(λ_1\ge \sqrt{2(1+δ)\log n})=n^{-ψ(δ)+o(1)}.$$ Further, we show that conditioned on the upper tail event, with high probability, a unique maximal clique emerges with a very precise $δ$ dependent size (takes either one or two possible values) and the Gaussian weights are uniformly high in absolute value on the edges in the clique. Finally, we also prove an optimal localization result for the leading eigenvector, showing that it allocates most of its mass on the aforementioned clique which is spread uniformly across its vertices.
2. (Lower tail probabilities): The exact stretched exponential behavior of $\mathbb{P}(λ_1\le \sqrt{2(1-δ)\log n})$ is also established.
As an immediate corollary, we get $λ_1 \approx \sqrt{2 \log n}$ typically, a result that surprisingly appears to be new. A key ingredient is an extremal spectral theory for weighted graphs obtained via the classical Motzkin-Straus theorem.
Spectral Edge in Sparse Random Graphs: Upper and Lower Tail Large Deviations
Published
• View Publication
• BIB
In this paper we consider the problem of estimating the joint upper and lower tail large deviations of the edge eigenvalues of an Erdős-Rényi random graph $\mathcal{G}_{n,p}$, in the regime of $p$ where the edge of the spectrum is no longer governed by global observables, such as the number of edges, but rather by localized statistics, such as high degree vertices. Going beyond the recent developments in mean-field approximations of related problems, this paper provides a comprehensive treatment of the large deviations of the spectral edge in this entire regime, which notably includes the well studied case of constant average degree. In particular, for $r \geq 1$ fixed, we pin down the asymptotic probability that the top $r$ eigenvalues are jointly greater/less than their typical values by multiplicative factors bigger/smaller than $1$, in the regime mentioned above. The proof for the upper tail relies on a novel structure theorem, obtained by building on estimates of Krivelevich and Sudakov (2003), followed by an iterative cycle removal process, which shows, conditional on the upper tail large deviation event, with high probability the graph admits a decomposition in to a disjoint union of stars and a spectrally negligible part. On the other hand, the key ingredient in the proof of the lower tail is a Ramsey-type result which shows that if the $K$-th largest degree of a graph is not atypically small (for some large $K$ depending on $r$), then either the top eigenvalue or the $r$-th largest eigenvalue is larger than that allowed by the lower tail event on the top $r$ eigenvalues, thus forcing a contradiction. The above arguments reduce the problems to developing a large deviation theory for the extremal degrees which could be of independent interest.
High-girth near-Ramanujan graphs with localized eigenvectors
Published
• View Publication
• BIB
We show that for every prime $d$ and $α\in (0,1/6)$, there is an infinite sequence of $(d+1)$-regular graphs $G=(V,E)$ with girth at least $2α\log_{d}(|V|)(1-o_d(1))$, second adjacency matrix eigenvalue bounded by $(3/\sqrt{2})\sqrt{d}$, and many eigenvectors fully localized on small sets of size $O(|V|^α)$. This strengthens the results of Ganguly-Srivastava, who constructed high girth (but not expanding) graphs with similar properties, and may be viewed as a discrete analogue of the "scarring" phenomenon observed in the study of quantum ergodicity on manifolds. Key ingredients in the proof are a technique of Kahale for bounding the growth rate of eigenfunctions of graphs, discovered in the context of vertex expansion and a method of Erdős and Sachs for constructing high girth regular graphs.
Upper Tails for Edge Eigenvalues of Random Graphs
Published in SIAM Journal on Discrete Mathematics, Vol. 34 (2), 1069-1083, 2020
• View Publication
• BIB
The upper tail problem for the largest eigenvalue of the Erdős--Rényi random graph $\mathcal{G}_{n,p}$ is to estimate the probability that the largest eigenvalue of the adjacency matrix of $\mathcal{G}_{n,p}$ exceeds its typical value by a factor of $1+δ$. In this note we show that for $δ>0$ fixed, and $p \rightarrow 0$ such that $n^{\frac{1}{2}} p \rightarrow \infty$, the upper tail probability for the largest eigenvalue of $\mathcal{G}_{n,p}$ is $$\exp\left[-(1+o(1)) \min\left\{\tfrac{(1+δ)^2}{2}, δ(1+δ) \right\} n^{2}p^{2}\log (1/p)\right].$$ In the same regime of $p$, we show that the second largest eigenvalue $λ_2( \mathcal G_{n,p})$ of the adjacency matrix of $\mathcal{G}_{n,p}$ satisfies $$\mathbb P(λ_2(\mathcal G_{n,p})\ge δnp) = \exp\left[-(1+o(1)) \tfrac{1}{2} δ^2n^2p^2 \log (1/p) \right],$$ where $δ=δ_n < 1$ can depend on $n$ such that $δn^{\frac{1}{2}} p \rightarrow \infty$, which covers deviations of $λ_2(\mathcal G_{n,p})$ between $n^{\frac{1}{2}}$ and $np$. Our arguments build on recent results on the large deviations of the largest eigenvalue and related non-linear functions of the adjacency matrix in terms of natural mean-field entropic variational problems.
Bounding the number of self-avoiding walks: Hammersley-Welsh with polygon insertion
Published in Ann. Probab. 48(4): 1644-1692 (2020)
• View Publication
• BIB
Let $c_n = c_n(d)$ denote the number of self-avoiding walks of length $n$ starting at the origin in the Euclidean nearest-neighbour lattice $\mathbb{Z}^d$. Let $μ= \lim_n c_n^{1/n}$ denote the connective constant of $\mathbb{Z}^d$. In 1962, Hammersley and Welsh [HW62] proved that, for each $d \geq 2$, there exists a constant $C > 0$ such that $c_n \leq \exp(C n^{1/2}) μ^n$ for all $n \in \mathbb{N}$. While it is anticipated that $c_n μ^{-n}$ has a power-law growth in $n$, the best known upper bound in dimension two has remained of the form $n^{1/2}$ inside the exponential.
The natural first improvement to demand for a given planar lattice is a bound of the form $c_n \leq \exp (C n^{1/2 - ε})μ^n$, where $μ$ denotes the connective constant of the lattice in question. We derive a bound of this form for two such lattices, for an explicit choice of $ε> 0$ in each case. For the hexagonal lattice $\mathbb{H}$, the bound is proved for all $n \in \mathbb{N}$; while for the Euclidean lattice $\mathbb{Z}^2$, it is proved for a set of $n \in \mathbb{N}$ of limit supremum density equal to one.
A power-law upper bound on $c_n μ^{-n}$ for $\mathbb{H}$ is also proved, contingent on a non-quantitative assertion concerning this lattice's connective constant.
On Non-localization of Eigenvectors of High Girth Graphs
Published in Int. Mat. Res., Volume 2021, Issue 8., April 2021, Pages 5766-5790
• View Publication
• BIB
We prove improved bounds on how localized an eigenvector of a high girth regular graph can be, and present examples showing that these bounds are close to sharp. This study was initiated by Brooks and Lindenstrauss (2009) who relied on the observation that certain suitably normalized averaging operators on high girth graphs are hyper-contractive and can be used to approximate projectors onto the eigenspaces of such graphs. Informally, their delocalization result in the contrapositive states that for any $\varepsilon \in (0,1)$ and positive integer $k,$ if a $(d+1)-$regular graph has an eigenvector which supports $\varepsilon$ fraction of the $\ell_2^2$ mass on a subset of $k$ vertices, then the graph must have a cycle of size $\tilde{O}(\log_{d}(k)/\varepsilon^2)$, suppressing logarithmic terms in $1/\varepsilon$. In this paper, we improve the upper bound to $\tilde{O}(\log_{d}(k)/\varepsilon)$ and present a construction showing a lower bound of $Ω(\log_d(k)/\varepsilon)$. Our construction is probabilistic and involves gluing together a pair of trees while maintaining high girth as well as control on the eigenvectors and could be of independent interest.
Delocalization of Polymers in Lower Tail Large Deviation
Published
• View Publication
• BIB
Directed last passage percolation models on the plane, where one studies the weight as well as the geometry of optimizing paths (called polymers) in a field of i.i.d. weights, are paradigm examples of models in the KPZ universality class. In this article, we consider the large deviation regime, i.e., when the polymer has a much smaller (lower tail) or larger (upper tail) weight than typical. Precise asymptotics of large deviation probabilities have been obtained in a handful of the so-called exactly solvable scenarios, including the Exponential (Johansson, '00) and Poissonian (Seppäläinen, '98 and Deuschel, Zeitouni, '99) cases. How the geometry of the optimizing paths change under such a large deviation event was considered in (Deuschel, Zeitouni, '99), where it was shown that the paths (from $(0,0)$ to $(n,n)$, say) remain concentrated around the straight line joining the end points in the upper tail large deviation regime, but the corresponding question in the lower tail was left open. We establish a contrasting behavior in the lower tail large deviation regime, showing that conditioned on the latter, in both the models, the optimizing paths are not concentrated around any deterministic curve. Our argument does not use any ingredient from integrable probability, and hence can be extended to other planar last passage percolation models under fairly mild conditions; and also to other non-integrable settings such as high dimensions.
Activated Random Walk on a cycle
Published
• View Publication
• BIB
We consider Activated Random Walk (ARW), a particle system with mass conservation, on the cycle $\mathbb{Z}/n\mathbb{Z}$. One starts with a mass density $μ>0$ of initially active particles, each of which performs a simple symmetric random walk at rate one and falls asleep at rate $λ>0.$ Sleepy particles become active on coming in contact with other active particles. There have been several recent results concerning fixation/non-fixation of the ARW dynamics on infinite systems depending on the parameters $μ$ and $λ$. On the finite graph $\mathbb{Z}/n\mathbb{Z}$, unless there are more than $n$ particles, the process fixates (reaches an absorbing state) almost surely in finite time. We show that the number of steps the process takes to fixate is linear in $n$ (up to poly-logarithmic terms), when the density is sufficiently low compared to the sleep rate, and exponential in $n$ when the sleep rate is sufficiently small compared to the density, reflecting the fixation/non-fixation phase transition in the corresponding infinite system as established by Rolla, Sidoravicius (2012).
The Competition of Roughness and Curvature in Area-Constrained Polymer Models
Published
• View Publication
• BIB
The competition between local Brownian roughness and global parabolic curvature experienced in many random interface models reflects an important aspect of the KPZ universality class. It may be summarised by an exponent triple $(1/2,1/3,2/3)$ representing local interface fluctuation, local roughness (or inward deviation) and convex hull facet length. The three effects arise, for example, in droplets in planar Ising models (Alexander, '01, Hammond, '11,'12). In this article, we offer a new perspective on this phenomenon. We consider directed last passage percolation model in the plane, a paradigmatic example in the KPZ universality class, and constrain the maximizing path under the additional requirement of enclosing an atypically large area. The interface suffers a constraint of parabolic curvature as before, but now its local structure is the KPZ fixed point polymer's rather than Brownian. The local interface fluctuation exponent is thus two-thirds rather than one-half. We prove that the facet lengths of the constrained path's convex hull are governed by an exponent of $3/4$, and inward deviation by an exponent of $1/2$. That is, the exponent triple is now $(2/3,1/2,3/4)$ in place of $(1/2,1/3,2/3)$. This phenomenon appears to be shared among various isoperimetrically extremal circuits in local randomness. Indeed, we formulate a conjecture to this effect concerning such circuits in supercritical percolation, whose Wulff-like first-order behaviour was recently established (Biskup, Louidor, Procaccia and Rosenthal, '12).
Upper triangular matrix walk: Cutoff for finitely many columns
Published
• View Publication
• BIB
We consider random walk on the group of uni-upper triangular matrices with entries in $\mathbb{F}_2$ which forms an important example of a nilpotent group. Peres and Sly (2013) proved tight bounds on the mixing time of this walk up to constants. It is well known that the single column projection of this chain is the one dimensional East process. In this article, we complement the Peres-Sly result by proving a cutoff result for the mixing of finitely many columns in the upper triangular matrix walk at the same location as the East process of the same dimension. Moreover, we also show that the spectral gaps of the matrix walk and the East process are equal. The proof of the cutoff result is based on a recursive argument which uses a local version of a dual process appearing in Peres and Sly (2013), various combinatorial consequences of mixing and concentration results for the movement of the front in the one dimensional East process.
$SO(N)$ Lattice Gauge Theory, planar and beyond
Published
• View Publication
• BIB
Lattice Gauge theories have been studied in the physics literature as discrete approximations to quantum Yang-Mills theory for a long time. Primary statistics of interest in these models are expectations of the so called "Wilson loop variables". In this article we continue the program initiated by Chatterjee (2015) to understand Wilson loop expectations in Lattice Gauge theories in a certain limit through gauge-string duality. The objective in this paper is to better understand the underlying combinatorics in the strong coupling regime, by giving a more geometric picture of string trajectories involving correspondence to objects such as decorated trees and non-crossing partitions. Using connections with Free Probability theory, we provide an elaborate description of loop expectations in the planar setting, which provides certain insights about structures of higher dimensional trajectories as well. Exploiting this, we construct an example showing that in any dimension, the Wilson loop area law lower bound does not hold in full generality.
Upper tails for arithmetic progressions in a random set
Published
• View Publication
• BIB
Let $X_k$ denote the number of $k$-term arithmetic progressions in a random subset of $\mathbb{Z}/N\mathbb{Z}$ or $\{1, \dots, N\}$ where every element is included independently with probability $p$. We determine the asymptotics of $\log \mathbb{P}(X_k \ge (1+δ) \mathbb{E} X_k)$ (also known as the large deviation rate) where $p \to 0$ with $p \ge N^{-c_k}$ for some constant $c_k > 0$, which answers a question of Chatterjee and Dembo. The proofs rely on the recent nonlinear large deviation principle of Eldan, which improved on earlier results of Chatterjee and Dembo. Our results complement those of Warnke, who used completely different methods to estimate, for the full range of $p$, the large deviation rate up to a constant factor.
Upper tails and independence polynomials in random graphs
Published in Adv. Math. 319 (2017), 313-347
• View Publication
• BIB
The upper tail problem in the Erdős--Rényi random graph $G\sim\mathcal{G}_{n,p}$ asks to estimate the probability that the number of copies of a graph $H$ in $G$ exceeds its expectation by a factor $1+δ$. Chatterjee and Dembo showed that in the sparse regime of $p\to 0$ as $n\to\infty$ with $p \geq n^{-α}$ for an explicit $α=α_H>0$, this problem reduces to a natural variational problem on weighted graphs, which was thereafter asymptotically solved by two of the authors in the case where $H$ is a clique.
Here we extend the latter work to any fixed graph $H$ and determine a function $c_H(δ)$ such that, for $p$ as above and any fixed $δ>0$, the upper tail probability is $\exp[-(c_H(δ)+o(1))n^2 p^Δ\log(1/p)]$, where $Δ$ is the maximum degree of $H$. As it turns out, the leading order constant in the large deviation rate function, $c_H(δ)$, is governed by the independence polynomial of $H$, defined as $P_H(x)=\sum i_H(k) x^k $ where $i_H(k)$ is the number of independent sets of size $k$ in $H$. For instance, if $H$ is a regular graph on $m$ vertices, then $c_H(δ)$ is the minimum between $\frac12 δ^{2/m}$ and the unique positive solution of $P_H(x) = 1+δ$.
Recovery and Rigidity in a Regular Stochastic Block Model
Published in Proceedings of the twenty-seventh annual ACM-SIAM symposium on Discrete algorithms, pp. 1589-1601. Society for Industrial and Applied Mathematics, 2016
• View Publication
• BIB
The stochastic block model is a natural model for studying community detection in random networks. Its clustering properties have been extensively studied in the statistics, physics and computer science literature. Recently this area has experienced major mathematical breakthroughs, particularly for the binary (two-community) version, see Mossel, Neeman, Sly (2012, 2013) and Massoulie (2013). In this paper, we introduce a variant of the binary model which we call the regular stochastic block model (RSBM). We prove rigidity by showing that with high probability an exact recovery of the community structure is possible. Spectral methods exhibit a regime where this can be done efficiently. Moreover we also prove that, in this setting, any suitably good partial recovery can be bootstrapped to obtain a full recovery of the communities.
Heat diffusion with frozen boundary
Published
• View Publication
• BIB
Consider "Frozen Random Walk" on $\mathbb{Z}$: $n$ particles start at the origin. At any discrete time, the leftmost and rightmost $\lfloor{\frac{n}{4}}\rfloor$ particles are "frozen" and do not move. The rest of the particles in the "bulk" independently jump to the left and right uniformly. The goal of this note is to understand the limit of this process under scaling of mass and time. To this end we study the following deterministic mass splitting process: start with mass $1$ at the origin. At each step the extreme quarter mass on each side is "frozen". The remaining "free" mass in the center evolves according to the discrete heat equation. We establish diffusive behavior of this mass evolution and identify the scaling limit under the assumption of its existence. It is natural to expect the limit to be a truncated Gaussian. A naive guess for the truncation point might be the $1/4$ quantile points on either side of the origin. We show that this is not the case and it is in fact determined by the evolution of the second moment of the mass distribution.