Papers by Remco van der Hofstad
42 paper(s) by this author
· All BibTeX
The stochastic block model has the overlap graph property for modularity
The overlap gap property (OGP) is a statement about the geometry of near-optimal solutions. Exhibiting OGP implies failure of a class of local algorithms; and has been observed to coincide with conjectured algorithmic limits in problems with statistical computational gap.
We consider the Stochastic Block Model (SBM), where the graph has a planted partition with $k$ equal-size blocks which form the `communities', and where, for parameters $p>q$, vertices within the same community connect with probability $p$, while vertices in different communities connect with probability $q$, independently across pairs of vertices. Modularity--based clustering algorithms have become ubiquitous in applications. This article studies theoretical limits of local algorithms based on the modularity score on the SBM.
We establish that modularity exhibits OGP on the SBM. This rules out a class of local algorithms based on modularity for recovery in the SBM, and shows slow mixing time for a related Markov Chain. Theoretically this is one of the few instances where OGP has been established for a `planted' model, as most such analyses to date consider the `null' model.
As part of our analysis, we extend a result by Bickel and Chen 2009, who established that with high probability, the modularity optimal partition of SBM is $o(n)$ local moves away from the planted partition, where $n$ is the graph size. We show that, with high probability, any partition with modularity score sufficiently near the optimal value is close to the planted partition.
The number and structure of connected graphs with a fixed degree sequence
We study connected graphs with a fixed degree sequence, in the sparse setting where the number of edges grows linearly in the number of vertices. Using the relation to the configuration model, we identify the number of such connected graphs up to the exponential order. We do this by viewing a connected graph with a given degree distribution as the realization of the giant component in a larger configuration model, and carefully choosing the degree distribution of the larger graph so that it is likely that its giant component has the required degree distribution. To ensure that the connected graph has exactly the correct degrees, we use a switching argument. Additionally, we obtain results on rare event probabilities and describe the local structure of a uniform connected graph with a fixed degree sequence.
The asymptotic rank of adjacency matrices of weighted configuration models over arbitrary fields
We study the asymptotic rank of adjacency matrices of a large class of edge-weighted configuration models. Here, the weight of a (multi-)edge can be any fixed non-zero element from an arbitrary field, as long as it is independent of the (multi-)graph. Our main result demonstrates that the asymptotic behavior of the normalized rank of the adjacency matrix neither depends on the fixed edge-weights, nor on which field they are chosen from. Our approach relies on a novel adaptation of the component exploration method of \cite{janson2009new}, which enables the application of combinatorial techniques from \cite{coja2022rank, HofMul25}.
The rank of sparse symmetric matrices over arbitrary fields
Let $\FF$ be an arbitrary field and $(\bm{G}_{n,d/n})_n$ be a sequence of sparse weighted Erdős-Rényi random graphs on $n$ vertices with edge probability $d/n$, where weights from $\FF \setminus\{0\}$ are assigned to the edges according to a fixed matrix $J_n$. We show that the normalised rank of the adjacency matrix of $(\bm{G}_{n,d/n})_n$ converges in probability to a constant, and derive the limiting expression. Our result shows that for the general class of sparse symmetric matrices under consideration, the asymptotics of the normalised rank are independent of the edge weights and even the field, in the sense that the limiting constant for the general case coincides with the one previously established for adjacency matrices of sparse (non-weighted) Erdős-Rényi matrices over $\RR$ from \cite{bordenave2011rank}. Our proof, which is purely combinatorial in its nature, is based on an intricate extension of the novel perturbation approach from \cite{coja2022rank} to the symmetric setting.
Rank-k random graphs and finite type branching processes
In this note, we investigate fundamental relations between exploration processes in random graphs, and branching processes. We formulate a class of models that we call {\em rank-$k$ random graphs}, and that are special in that their neighborhood explorations can be obtained by a {\em thinning} of multi-type branching processes. We show that any rank-2 random graph can be described in terms of thinning of a 2-type branching process, while for higher rank, it is not clear how many types are needed.
Sparse random graphs with many triangles
Published
• View Publication
• BIB
In this paper we consider the Erdős-Rényi random graph in the sparse regime in the limit as the number of vertices $n$ tends to infinity. We are interested in what this graph looks like when it contains many triangles, in two settings. First, we derive asymptotically sharp bounds on the probability that the graph contains a large number of triangles. We show that conditionally on this event, with high probability the graph contains an almost complete subgraph, i.e., the triangles form a near-clique, and has the same local limit as the original Erdős-Rényi random graph. Second, we derive asymptotically sharp bounds on the probability that the graph contains a large number of vertices that are part of a triangle. If order $n$ vertices are in triangles, then the local limit (provided it exists) is different from that of the Erdős-Rényi random graph. Our results shed light on the challenges that arise in the description of real-world networks, which often are sparse, yet highly clustered, and on exponential random graphs, which often are used to model such networks.
Glauber dynamics for Ising models on random regular graphs: cut-off and metastability
Published
• View Publication
• BIB
Consider random $d$-regular graphs, i.e., random graphs such that there are exactly $d$ edges from each vertex for some $d\ge 3$. We study both the configuration model version of this graph, which has occasional multi-edges and self-loops, as well as the simple version of it, which is a $d$-regular graph chosen uniformly at random from the collection of all $d$-regular graphs.
In this paper, we discuss mixing times of Glauber dynamics for the Ising model with an external magnetic field on a random $d$-regular graph, both in the quenched as well as the annealed settings. Let $β$ be the inverse temperature, $β_c$ be the critical temperature and $B$ be the external magnetic field. Concerning the annealed measure, we show that for $β> β_c$ there exists $\hat{B}_c(β)\in (0,\infty)$ such that the model is metastable (i.e., the mixing time is exponential in the graph size $n$) when $β> β_c$ and $0 \leq B < \hat{B}_c(β)$, whereas it exhibits the cut-off phenomenon at $c_\star n \log n$ with a window of order $n$ when $β< β_c$ or $β> β_c$ and $B>\hat{B}_c(β)$. Interestingly, $\hat{B}_c(β)$ coincides with the critical external field of the Ising model on the $d$-ary tree (namely, above which the model has a unique Gibbs measure). Concerning the quenched measure, we show that there exists $B_c(β)$ with $B_c(β) \leq \hat{B}_c(β)$ such that for $β> β_c$, the mixing time is at least exponential along some subsequence $(n_k)_{k\geq 1}$ when $0 \leq B < B_c(β)$, whereas it is less than or equal to $Cn\log n$ when $B>\hat{B}_c(β)$. The quenched results also hold for the model conditioned on simplicity, for the annealed results this is unclear.
Phase transition in random intersection graphs with communities
The `random intersection graph with communities' models networks with communities, assuming an underlying bipartite structure of groups and individuals. Each group has its own internal structure described by a (small) graph, while groups may overlap. The group memberships are generated by a bipartite configuration model. The model generalizes the classical random intersection graph model that is included as the special case where each community is a complete graph (or clique).
The `random intersection graph with communities' is analytically tractable. We prove a phase transition in the size of the largest connected component based on the choice of model parameters. Further, we prove that percolation on our model produces a graph within the same family, and that percolation also undergoes a phase transition. Our proofs rely on the connection to the bipartite configuration model, however, with the arbitrary structure of the groups, it is not completely straightforward to translate results on the group structure into results on the graph. Our related results on the bipartite configuration model are not only instrumental to the study of the random intersection graph with communities, but are also of independent interest, and shed light on interesting differences from the unipartite case.
The number of partial Steiner systems and $d$-partitions
Published in Advances in Combinatorics, 2022:2, 23pp
• View Publication
• BIB
We prove asymptotic upper bounds on the number of $d$-partitions (paving matroids of fixed rank) and partial Steiner systems (sparse paving matroids of fixed rank), using a mixture of entropy counting, sparse encoding, and the probabilistic method.
Random intersection graphs with communities
Published in Adv. Appl. Probab. 53 (2021) 1061-1089
• View Publication
• BIB
Random intersection graphs model networks with communities, assuming an underlying bipartite structure of groups and individuals, where these groups may overlap. Group memberships are generated through the bipartite configuration model. Conditionally on the group memberships, the classical random intersection graph is obtained by connecting individuals when they are together in at least one group. We generalize this definition, allowing for arbitrary community structures within the groups.
In our new model, groups might overlap and they have their own internal structure described by a graph, the classical setting corresponding to groups being complete graphs. Our model turns out to be tractable. We analyze the overlapping structure of the communities, derive the asymptotic degree distribution and the local clustering coefficient. These proofs rely on local weak convergence, which also implies that subgraph counts converge. We further exploit the connection to the bipartite configuration model, for which we also prove local weak convergence, and which is interesting in its own right.
Cliques in rank-1 random graphs: the role of inhomogeneity
Published
• View Publication
• BIB
We study the asymptotic behavior of the clique number in rank-1 inhomogeneous random graphs, where edge probabilities between vertices are roughly proportional to the product of their vertex weights. We show that the clique number is concentrated on at most two consecutive integers, for which we provide an expression. Interestingly, the order of the clique number is primarily determined by the overall edge density, with the inhomogeneity only affecting multiplicative constants or adding at most a $\log\log(n)$ multiplicative factor. For sparse enough graphs the clique number is always bounded and the effect of inhomogeneity completely vanishes.
Universality for critical heavy-tailed network models: Metric structure of maximal components
Published in Electron. J. Probab. 25, no. 47, 1-57 (2020)
• View Publication
• BIB
We study limits of the largest connected components (viewed as metric spaces) obtained by critical percolation on uniformly chosen graphs and configuration models with heavy-tailed degrees. For rank-one inhomogeneous random graphs, such results were derived by Bhamidi, van der Hofstad, Sen [Probab. Theory Relat. Fields 2018]. We develop general principles under which the identical scaling limits as the rank-one case can be obtained. Of independent interest, we derive refined asymptotics for various susceptibility functions and the maximal diameter in the barely subcritical regime.
Heavy-tailed configuration models at criticality
Published in Ann. Inst. H. Poincaré Probab. Statist., 56, no. 3 (2020), 1515-1558
• View Publication
• BIB
We study the critical behavior of the component sizes for the configuration model when the tail of the degree distribution of a randomly chosen vertex is a regularly-varying function with exponent $τ-1$, where $τ\in (3,4)$. The component sizes are shown to be of the order $n^{(τ-2)/(τ-1)}L(n)^{-1}$ for some slowly-varying function $L(\cdot)$. We show that the re-scaled ordered component sizes converge in distribution to the ordered excursions of a thinned Lévy process. This proves that the scaling limits for the component sizes for these heavy-tailed configuration models are in a different universality class compared to the Erdős-Rényi random graphs. Also the joint re-scaled vector of ordered component sizes and their surplus edges is shown to have a distributional limit under a strong topology. Our proof resolves a conjecture by Joseph, Ann. Appl. Probab. (2014) about the scaling limits of uniform simple graphs with i.i.d degrees in the critical window, and sheds light on the relation between the scaling limits obtained by Joseph and in this paper, which appear to be quite different. Further, we use percolation to study the evolution of the component sizes and the surplus edges within the critical scaling window, which is shown to converge in finite dimension to the augmented multiplicative coalescent process introduced by Bhamidi et. al., Probab. Theory Related Fields (2014). The main results of this paper are proved under rather general assumptions on the vertex degrees. We also discuss how these assumptions are satisfied by some of the frameworks that have been studied previously.
When is a scale-free graph ultra-small?
Published
• View Publication
• BIB
In this paper we study typical distances in the configuration model, when the degrees have asymptotically infinite variance. We assume that the empirical degree distribution follows a power law with exponent $τ\in (2,3)$, up to value $n^{β_n}$ for some $β_n\gg (\log n)^{-γ}$ and $γ\in(0,1)$. This assumption is satisfied for power law i.i.d. degrees, and also includes truncated power-law distributions where the (possibly exponential) truncation happens at $n^{β_n}$. We show that the graph distance between two uniformly chosen vertices centers around $2 \log \log (n^{β_n}) / |\log (τ-2)| + 1/(β_n(3-τ))$, with tight fluctuations. Thus, the graph is an \emph{ultrasmall world} whenever $1/β_n=o(\log\log n)$. We determine the distribution of the fluctuations around this value, in particular we prove that these are non-converging tight random variables that show $\log \log$-periodicity. We describe the topology and number of shortest paths: We show that the number of shortest paths is of order $n^{f_nβ_n}$, where $f_n \in (0,1)$ is a random variable that oscillates with $n$. The two end-segments of any shortest path have length $\log \log (n^{β_n}) / |\log (τ-2)|$+tight, and the total degree is increasing towards the middle of the path on these segments. The connecting middle segment has length $1/(β_n(3-τ))$+tight, and it contains only vertices with degree at least of order $n^{(1-f_n)β_n}$, thus all the degrees on this segment are comparable to the maximal degree. Our theorems also apply when instead of truncating the degrees, we start with a configuration model and we remove every vertex with degree at least $n^{β_n}$, and the edges attached to these vertices. This sheds light on the attack vulnerability of the configuration model with infinite variance degrees.
Critical window for connectivity in the Configuration Model
Published
• View Publication
• BIB
We identify the asymptotic probability of a configuration model $\mathrm{CM}_n(\boldsymbol{d})$ to produce a connected graph within its critical window for connectivity that is identified by the number of vertices of degree 1 and 2, as well as the expected degree. In this window, the probability that the graph is connected converges to a non-trivial value, and the size of the complement of the giant component weakly converges to a finite random variable. Under a finite second moment condition we also derive the asymptotics of the connectivity probability conditioned on simplicity, from which the asymptotic number of simple connected graphs with a prescribed degree sequence follows.
The multiplicative coalescent, inhomogeneous continuum random trees, and new universality classes for critical random graphs
Published
• View Publication
• BIB
One major open conjecture in the area of critical random graphs, formulated by statistical physicists, and supported by a large amount of numerical evidence over the last decade [23, 24, 28, 63] is as follows: for a wide array of random graph models with degree exponent $τ\in (3,4)$, distances between typical points both within maximal components in the critical regime as well as on the minimal spanning tree on the giant component in the supercritical regime scale like $n^{(τ-3)/(τ-1)}$.
In this paper we study the metric space structure of maximal components of the multiplicative coalescent, in the regime where the sizes converge to excursions of Lévy processes "without replacement" [10], yielding a completely new class of limiting random metric spaces. A by-product of the analysis yields the continuum scaling limit of one fundamental class of random graph models with degree exponent $τ\in (3,4)$ where edges are rescaled by $n^{-(τ-3)/(τ-1)}$ yielding the first rigorous proof of the above conjecture. The limits in this case are compact "tree-like" random fractals with finite fractal dimensions and with a dense collection of hubs (infinite degree vertices) a finite number of which are identified with leaves to form shortcuts. In a special case, we show that the Minkowski dimension of the limiting spaces equal $(τ-2)/(τ-3)$ a.s., in stark contrast to the Erdős-Rényi scaling limit whose Minkowski dimension is 2 a.s. It is generally believed that dynamic versions of a number of fundamental random graph models, as one moves from the barely subcritical to the critical regime can be approximated by the multiplicative coalescent. In work in progress, the general theory developed in this paper is used to prove analogous limit results for other random graph models with degree exponent $τ\in (3,4)$.
First passage percolation on random graphs with infinite variance degrees
We prove non-universality results for first-passage percolation on the configuration model with i.i.d. degrees having infinite variance. We focus on the weight of the optimal path between two uniform vertices. Depending on the properties of the weight distribution, we use an example-based approach and show that rather different behaviors are possible. When the weights are a.s. larger than a constant, the weight and number of edges in the graph grow proportionally to loglog(n), as for the graph distances. On the other hand, when the continuous-time branching process describing the first passage percolation exploration through the graph reaches infinitely many vertices in finite time, the weight converges to the sum of two i.i.d. random variables representing the explosion times of the processes started from the two sources. This non-universality is in sharp contrast to the setting where the degree sequence has a finite variance (see Bhamidi, Hofstad and Hooghiemstra arXiv: 1210.6839).
Fixed speed competition on the configuration model with infinite variance degrees: equal speeds
We study competition of two spreading colors starting from single sources on the configuration model with i.i.d. degrees following a power-law distribution with exponent $τ\in (2,3)$. In this model two colors spread with a fixed and equal speed on the unweighted random graph.
We analyse how many vertices the two colors paint eventually. We show that coexistence sensitively depends on the initial local neighborhoods of the source vertices: if these neighborhoods are `dissimilar enough', then there is no coexistence, and the `loser' color paints a polynomial fraction of the vertices with a random exponent.
If the local neighborhoods of the starting vertices are `similar enough', then there is coexistence, i.e., both colors paint a strictly positive proportion of vertices. We give a quantitative characterization of `similar' local neighborhoods: two random variables describing the double exponential growth of local neighborhoods of the source vertices must be within a factor $τ-2$ of each other. Both of the two outcomes happen with positive probability with asymptotic value that is explicitly computable.
This picture reinforces the common belief that location is an important feature in advertising.
This paper is a follow-up of the similarly named paper that handles the case when the speeds of the two colors are not equal. There, we have shown that the faster color paints almost all vertices, while the slower color paints only a random sub-polynomial fraction of the vertices.
Fixed speed competition on the configuration model with infinite variance degrees: unequal speeds
Published in Electronic Journal of Probability, Volume 20 (2015), 48 pp
• View Publication
• BIB
We study competition of two spreading colors starting from single sources on the configuration model with i.i.d. degrees following a power-law distribution with exponent tau in (2,3). In this model two colors spread with a fixed but not necessarily equal speed on the unweighted random graph. We show that if the speeds are not equal, then the faster color paints almost all vertices, while the slower color can paint only a random subpolynomial fraction of the vertices. We investigate the case when the speeds are equal and typical distances in a follow-up paper.
Universality for first passage percolation on sparse random graphs
Published
• View Publication
• BIB
We consider first passage percolation on sparse random graphs with prescribed degree distributions and general independent and identically distributed edge weights assumed to have a density. Assuming that the degree distribution satisfies a uniform X^2\log{X}-condition, we analyze the asymptotic distribution for the minimal weight path between a pair of typical vertices, as well the number of edges on this path or hopcount.
The hopcount satisfies a central limit theorem where the norming constants are expressible in terms of the parameters of an associated continuous-time branching process. Centered by a multiple of \log{n}, where the constant is the inverse of the Malthusian rate of growth of the associated branching process, the minimal weight converges in distribution. The limiting random variable equals the sum of the logarithms of the martingale limits of the branching processes that measure the relative growth of neighborhoods about the two vertices, and a Gumbel random variable, and thus shows a remarkably universal behavior.
The proofs rely on a refined coupling between the shortest path problems on these graphs and continuous-time branching processes, and on a Poisson point process limit for the potential closing edges of shortest-weight paths between the source and destination.
The results extend to a host of related random graph models, ranging from random r-regular graphs, inhomogeneous random graphs and uniform random graphs with a prescribed degree sequence.