probability distribution
284 papers tagged with this keyword
Cokernels of random matrices satisfy the Cohen-Lenstra heuristics
Let A be an n by n random matrix with iid entries taken from the p-adic integers or Z/NZ. Then under mild non-degeneracy conditions the cokernel of A has a universal probability distribution. In particular, the p-part of an iid random matrix over the integers has cokernel distributed according to the Cohen-Lenstra measure up to an exponentially small error.
Polyhedral computational geometry for averaging metric phylogenetic trees
Published
• View Publication
• BIB
This paper investigates the computational geometry relevant to calculations of the Frechet mean and variance for probability distributions on the phylogenetic tree space of Billera, Holmes and Vogtmann, using the theory of probability measures on spaces of nonpositive curvature developed by Sturm. We show that the combinatorics of geodesics with a specified fixed endpoint in tree space are determined by the location of the varying endpoint in a certain polyhedral subdivision of tree space. The variance function associated to a finite subset of tree space has a fixed $C^\infty$ algebraic formula within each cell of the corresponding subdivision, and is continuously differentiable in the interior of each orthant of tree space. We use this subdivision to establish two iterative methods for producing sequences that converge to the Frechet mean: one based on Sturm's Law of Large Numbers, and another based on descent algorithms for finding optima of smooth functions on convex polyhedra. We present properties and biological applications of Frechet means and extend our main results to more general globally nonpositively curved spaces composed of Euclidean orthants.
The Encoding of Natural Numbers as Nested Parentheses Strings with Associated Probability Distributions
We provide an efficient encoding of the natural numbers {0,1,2,3,...} as strings of nested parentheses {(),(()),(()()),((())),...}, or considered inversely, an efficient enumeration of such strings. The technique is based on the recursive definition of the Catalan numbers. The probability distributions arising from this encoding are explored. Applications of this encoding to prefix-free data encoding and recursive function theory are briefly considered.
Polymatroids and polyquantoids
Published in \emph{Proceedings of WUPES 2012}, Sept.\ 12--15, Mariánské Láznì, Czech Republic, 126--136
• Search Publication
When studying entropy functions of multivariate probability distributions, polymatroids and matroids emerge. Entropy functions of pure multiparty quantum states give rise to analogous notions, called here polyquantoids and quantoids. Polymatroids and polyquantoids are related via linear mappings and duality. Quantum secret sharing schemes that are ideal are described by selfdual matroids. Expansions of integer polyquantoids to quantoids are studied and linked to that of polymatroids.
Geometric RSK correspondence, Whittaker functions and symmetrized random polymers
Published in Invent. math. 197, 361-416 (2014)
• View Publication
• BIB
We show that the geometric lifting of the RSK correspondence introduced by A.N. Kirillov (2001) is volume preserving with respect to a natural product measure on its domain, and that the integrand in Givental's integral formula for GL(n,R)-Whittaker functions arises naturally in this context. Apart from providing further evidence that Whittaker functions are the natural analogue of Schur polynomials in this setting, our results also provide a new `combinatorial' framework for the study of random polymers. When the input matrix consists of random inverse gamma distributed weights, the probability distribution of a polymer partition function constructed from these weights can be written down explicitly in terms of Whittaker functions. Next we restrict the geometric RSK mapping to symmetric matrices and show that the volume preserving property continues to hold. We determine the probability law of the polymer partition function with inverse gamma weights that are constrained to be symmetric about the main diagonal, with an additional factor on the main diagonal. The third combinatorial mapping studied is a variant of the geometric RSK mapping for triangular arrays, which is again showed to be volume preserving. This leads to a formula for the probability distribution of a polymer model whose paths are constrained to stay below the diagonal. We also show that the analogues of the Cauchy-Littlewood identity in the setting of this paper are equivalent to a collection of Whittaker integral identities conjectured by Bump (1989) and Bump and Friedberg (1990) and proved by Stade (2001, 2002). Our approach leads to new `combinatorial' proofs and generalizations of these identities, with some restrictions on the parameters.
Simple Asymmetric Exclusion Model and Lattice Paths: Bijections and Involutions
Published
• View Publication
• BIB
We study the combinatorics of the change of basis of three representations of the stationary state algebra of the two parameter simple asymmetric exclusion process. Each of the representations considered correspond to a different set of weighted lattice paths which, when summed over, give the stationary state probability distribution. We show that all three sets of paths are combinatorially related via sequences of bijections and sign reversing involutions.
Bounding the partition function of spin-systems
With a graph $G=(V,E)$ we associate a collection of non-negative real weights $\cup_{v\in V}{λ_{i,v}:1\leq i \leq m} \cup \cup_{uv \in E} {λ_{ij,uv}:1\leq i \leq j \leq m}$. We consider the probability distribution on ${f:V\rightarrow{1,...,m}}$ in which each $f$ occurs with probability proportional to $\prod_{v \in V}λ_{f(v),v}\prod_{uv \in E}λ_{f(u)f(v),uv}$. Many well-known statistical physics models, including the Ising model with an external field and the hard-core model with non-uniform activities, can be framed as such a distribution. We obtain an upper bound, independent of $G$, for the partition function (the normalizing constant which turns the assignment of weights on $\{f:V\rightarrow{1,...,m\}}$ into a probability distribution) in the case when $G$ is a regular bipartite graph. This generalizes a bound obtained by Galvin and Tetali who considered the simpler weight collection $\{λ_i:1 \leq i \leq m\} \cup \{λ_{ij}:1 \leq i \leq j \leq m\}$ with each $λ_{ij}$ either 0 or 1 and with each $f$ chosen with probability proportional to $\prod_{v \in V}λ_{f(v)}\prod_{uv \in E}λ_{f(u)f(v)}$. Our main tools are a generalization to list homomorphisms of a result of Galvin and Tetali on graph homomorphisms and a straightforward second-moment computation.
When Does a Mixture of Products Contain a Product of Mixtures?
We derive relations between theoretical properties of restricted Boltzmann machines (RBMs), popular machine learning models which form the building blocks of deep learning models, and several natural notions from discrete mathematics and convex geometry. We give implications and equivalences relating RBM-representable probability distributions, perfectly reconstructible inputs, Hamming modes, zonotopes and zonosets, point configurations in hyperplane arrangements, linear threshold codes, and multi-covering numbers of hypercubes. As a motivating application, we prove results on the relative representational power of mixtures of product distributions and products of mixtures of pairs of product distributions (RBMs) that formally justify widely held intuitions about distributed representations. In particular, we show that a mixture of products requiring an exponentially larger number of parameters is needed to represent the probability distributions which can be obtained as products of mixtures.
Formal Groups, Witt vectors and Free Probability
We establish a link between free probability theory and Witt vectors, via the theory of formal groups. We derive an exponential isomorphism which expresses Voiculescu's free multiplicative convolution $\boxtimes$ as a function of the free additive convolution $\boxplus$. Subsequently we continue our previous discussion of the relation between complex cobordism and free probability. We show that the generic $n$th free cumulant corresponds to the cobordism class of the $(n-1)$-dimensional complex projective space. This permits us to relate several probability distributions from random matrix theory to known genera, and to build a dictionary. Finally, we discuss aspects of free probability and the asymptotic representation theory of the symmetric group from a conformal field theoretic perspective and show that every distribution with mean zero is embeddable into the Universal Grassmannian of Sato-Segal-Wilson.
Fully Analyzing an Algebraic Polya Urn Model
Published
• View Publication
• BIB
This paper introduces and analyzes a particular class of Polya urns: balls are of two colors, can only be added (the urns are said to be additive) and at every step the same constant number of balls is added, thus only the color compositions varies (the urns are said to be balanced). These properties make this class of urns ideally suited for analysis from an "analytic combinatorics" point-of-view, following in the footsteps of Flajolet-Dumas-Puyhaubert, 2006. Through an algebraic generating function to which we apply a multiple coalescing saddle-point method, we are able to give precise asymptotic results for the probability distribution of the composition of the urn, as well as local limit law and large deviation bounds.
Enumeration of k-Exceedance Lattice Paths with an Application to Comparing Chains of Order Statistics
We enumerate the number of monotonic lattice paths starting at $(0,0)$ and terminating at $(m,n)$ in which $l$ of the first $k$ steps lie below the line $y=x\ (0\leq k\leq m\leq n)$. These closed formulas consist of terms which are a product Catalan numbers, ballot numbers and binomial coefficients. We then apply the combinatorial formulas to failure analysis by deriving a probability distribution that compares the performance of a $k$-out-of-$m$ system to a $k$-out-of-$n$ system of continuous, independent, and identically distributed random variables. Lastly, we provide asymptotics in a few special cases of $k,m,n$ and leave others as conjecture.
On protected nodes in Digital Search Trees
Published
• View Publication
• BIB
Recently, 2-protected nodes were studied in the context of ordered trees and $k$-trees. These nodes have a distance of at least 2 to each leaf. Here, we study digital search trees, which are binary trees, but with a different probability distribution underlying. Our result says, that \emph{grosso modo} some 31% of the nodes are 2-protected. Methods include exponential generating functions, contour integration, and some elements from $q$-analysis.
Maximum edge-cuts in cubic graphs with large girth and in random cubic graphs
Published
• View Publication
• BIB
We show that for every cubic graph G with sufficiently large girth there exists a probability distribution on edge-cuts of G such that each edge is in a randomly chosen cut with probability at least 0.88672. This implies that G contains an edge-cut of size at least 1.33008n, where n is the number of vertices of G, and has fractional cut covering number at most 1.127752. The lower bound on the size of maximum edge-cut also applies to random cubic graphs. Specifically, a random n-vertex cubic graph a.a.s. contains an edge cut of size 1.33008n.
The two-sided infinite extension of the Mallows model for random permutations
Published in Advances in Applied Mathematics 48 (2012), no. 5, 615-639
• View Publication
• BIB
We introduce a probability distribution Q on the group of permutations of the set Z of integers. Distribution Q is a natural extension of the Mallows distribution on the finite symmetric group. A one-sided infinite counterpart of Q, supported by the group of permutations of the set N of natural numbers, was studied previously in our paper [Gnedin and Olshanski, Ann. Prob. 38 (2010), 2103-2135; arXiv:0907.3275]. We analyze various features of Q such as its symmetries, the support, and the marginal distributions.
On the chromatic number of random geometric graphs
Published in Combinatorica, Volume 31 (2011), Number 4, Pages 423-488
• View Publication
• BIB
Given independent random points $X_1,...,X_n\in\eR^d$ with common probability distribution $ν$, and a positive distance $r=r(n)>0$, we construct a random geometric graph $G_n$ with vertex set $\{1,...,n\}$ where distinct $i$ and $j$ are adjacent when $\norm{X_i-X_j}\leq r$. Here $\norm{.}$ may be any norm on $\eR^d$, and $ν$ may be any probability distribution on $\eR^d$ with a bounded density function. We consider the chromatic number $χ(G_n)$ of $G_n$ and its relation to the clique number $ω(G_n)$ as $n \to \infty$. Both McDiarmid and Penrose considered the range of $r$ when $r \ll (\frac{\ln n}{n})^{1/d}$ and the range when $r \gg (\frac{\ln n}{n})^{1/d}$, and their results showed a dramatic difference between these two cases. Here we sharpen and extend the earlier results, and in particular we consider the `phase change' range when $r \sim (\frac{t\ln n}{n})^{1/d}$ with $t>0$ a fixed constant. Both McDiarmid and Penrose asked for the behaviour of the chromatic number in this range. We determine constants $c(t)$ such that $\frac{χ(G_n)}{nr^d}\to c(t)$ almost surely. Further, we find a "sharp threshold" (except for less interesting choices of the norm when the unit ball tiles $d$-space): there is a constant $t_0>0$ such that if $t \leq t_0$ then $\frac{χ(G_n)}{ω(G_n)}$ tends to 1 almost surely, but if $t > t_0$ then $\frac{χ(G_n)}{ω(G_n)}$ tends to a limit $>1$ almost surely.
Limits of compact decorated graphs
Following a general program of studying limits of discrete structures, and motivated by the theory of limit objects of converge sequences of dense simple graphs, we study the limit of graph sequences such that every edge is labeled by an element of a compact second-countable Hausdorff space K. The "local structure" of these objects can be explored by a sampling process, which is shown to be equivalent to knowing homomorphism numbers from graphs whose edges are decorated by continuous functions on K. The model includes multigraphs with bounded edge multiplicities, graphs whose edges are weighted with real numbers from a finite interval, edge-colored graphs, and other models. In all these cases, a limit object can be defined in terms of 2-variable functions whose values are probability distributions on K.
New Polynomials and Numbers Associated with Fractional Poisson Probability Distribution
Published in AIP Conference Proceedings Vol 1281, (2010), pp. 1152-1155
• View Publication
• BIB
Generalizations of Bell polynomials, Bell numbers, and Stirling numbers of the second kind have been introduced and their generating functions were evaluated.
A stronger result on fractional strong colourings
Aharoni, Berger and Ziv recently proved the fractional relaxation of the strong colouring conjecture. In this note we generalize their result as follows. Let $k\geq 1$ and partition the vertices of a graph $G$ into sets $V_1,..., V_r$, such that for $1\leq i \leq r$ every vertex in $V_i$ has at most $\max\{k, |V_i|-k \}$ neighbours outside $V_i$. Then there is a probability distribution on the stable sets of $G$ such that a stable set drawn from this distribution hits each vertex in $V_i$ with probability $1/|V_i|$, for $1\leq i\leq r$. We believe that this result will be useful as a tool in probabilistic approaches to bounding the chromatic number and fractional chromatic number.
Reconstructing pedigrees: some identifiability questions for a recombination-mutation model
Published in Journal of Mathematical Biology, 66, issue 1-2 (2013) 37-74
• View Publication
• BIB
Pedigrees are directed acyclic graphs that represent ancestral relationships between individuals in a population. Based on a schematic recombination process, we describe two simple Markov models for sequences evolving on pedigrees - Model R (recombinations without mutations) and Model RM (recombinations with mutations). For these models, we ask an identifiability question: is it possible to construct a pedigree from the joint probability distribution of extant sequences? We present partial identifiability results for general pedigrees: we show that when the crossover probabilities are sufficiently small, certain spanning subgraph sequences can be counted from the joint distribution of extant sequences. We demonstrate how pedigrees that earlier seemed difficult to distinguish are distinguished by counting their spanning subgraph sequences.
(Very) short proof of Rayleigh's Theorem (and extensions)
Published
• View Publication
• BIB
Consider a walk in the plane made of $n$ unit steps, with directions chosen independently and uniformly at random at each step. Rayleigh's theorem asserts that the probability for such a walk to end at a distance less than 1 from its starting point is $1/(n+1)$. We give an elementary proof of this result. We also prove the following generalization valid for any probability distribution $μ$ on the positive real numbers: if two walkers start at the same point and make respectively $m$ and $n$ independent steps with uniformly random directions and with lengths chosen according to $μ$, then the probability that the first walker ends farther than the second is $m/(m+n)$.