statistical model
46 papers tagged with this keyword
Identifiability in Phylogenetics using Algebraic Matroids
Published
• View Publication
• BIB
Identifiability is a crucial property for a statistical model since distributions in the model uniquely determine the parameters that produce them. In phylogenetics, the identifiability of the tree parameter is of particular interest since it means that phylogenetic models can be used to infer evolutionary histories from data. In this paper we introduce a new computational strategy for proving the identifiability of discrete parameters in algebraic statistical models that uses algebraic matroids naturally associated to the models. We then use this algorithm to prove that the tree parameters are generically identifiable for 2-tree CFN and K3P mixtures. We also show that the $k$-cycle phylogenetic network parameter is identifiable under the K2P and K3P models.
Statistical Robust Chinese Remainder Theorem for Multiple Numbers
Generalized Chinese Remainder Theorem (CRT) is a well-known approach to solve ambiguity resolution related problems. In this paper, we study the robust CRT reconstruction for multiple numbers from a view of statistics. To the best of our knowledge, it is the first rigorous analysis on the underlying statistical model of CRT-based multiple parameter estimation. To address the problem, two novel approaches are established. One is to directly calculate a conditional maximum a posteriori probability (MAP) estimation of the residue clustering, and the other is based on a generalized wrapped Gaussian mixture model to iteratively search for MAP of both estimands and clustering. Residue error correcting codes are introduced to improve the robustness further. Experimental results show that the statistical schemes achieve much stronger robustness compared to state-of-the-art deterministic schemes, especially in heavy-noise scenarios.
Self-Assembly of Geometric Space from Random Graphs
Published in Classical and Quantum Gravity, 2019
• View Publication
• BIB
We present a Euclidean quantum gravity model in which random graphs dynamically self-assemble into discrete manifold structures. Concretely, we consider a statistical model driven by a discretisation of the Euclidean Einstein-Hilbert action; contrary to previous approaches based on simplicial complexes and Regge calculus our discretisation is based on the Ollivier curvature, a coarse analogue of the manifold Ricci curvature defined for generic graphs. The Ollivier curvature is generally difficult to evaluate due to its definition in terms of optimal transport theory, but we present a new exact expression for the Ollivier curvature in a wide class of relevant graphs purely in terms of the numbers of short cycles at an edge. This result should be of independent intrinsic interest to network theorists. Action minimising configurations prove to be cubic complexes up to defects; there are indications that such defects are dynamically suppressed in the macroscopic limit. Closer examination of a defect free model shows that certain classical configurations have a geometric interpretation and discretely approximate vacuum solutions to the Euclidean Einstein-Hilbert action. Working in a configuration space where the geometric configurations are stable vacua of the theory, we obtain direct numerical evidence for the existence of a continuous phase transition; this makes the model a UV completion of Euclidean Einstein gravity. Notably, this phase transition implies an area-law for the entropy of emerging geometric space. Certain vacua of the theory can be interpreted as baby universes; we find that these configurations appear as stable vacua in a mean field approximation of our model, but are excluded dynamically whenever the action is exact indicating the dynamical stability of geometric space. The model is intended as a setting for subsequent studies of emergent time mechanisms.
Construction of an algebra corresponding to a statistical model of the square ladder (square lattice with two lines)
Published in Nuclear Physics B, 2022
• View Publication
• BIB
In this paper we define infinite-dimensional algebra and its representation, whose basis is naturally identified with semi-infinite configurations of the square ladder model. We also extrapolate the ideas for the cyclic 3-leg triangular ladder model. All of these propose a way for generalization, which leads to representations of N = 2, ... algebras.
Keywords: 2D lattice, square ladder, triangular ladder, conformal algebra, semi-infinite forms, fermions, quadratic algebra, superfrustration, graded Euler characteristic, cohomology, deformation, Jacobi triple product, superalgebras, operator algebras, N = 2, ... algebras.
A reverse Sidorenko inequality
Published
• View Publication
• BIB
Let $H$ be a graph allowing loops as well as vertex and edge weights. We prove that, for every triangle-free graph $G$ without isolated vertices, the weighted number of graph homomorphisms $\hom(G, H)$ satisfies the inequality \[ \hom(G, H ) \le \prod_{uv \in E(G)} \hom(K_{d_u,d_v}, H )^{1/(d_ud_v)}, \] where $d_u$ denotes the degree of vertex $u$ in $G$. In particular, one has \[ \hom(G, H )^{1/|E(G)|} \le \hom(K_{d,d}, H )^{1/d^2} \] for every $d$-regular triangle-free $G$. The triangle-free hypothesis on $G$ is best possible. More generally, we prove a graphical Brascamp-Lieb type inequality, where every edge of $G$ is assigned some two-variable function. These inequalities imply tight upper bounds on the partition function of various statistical models such as the Ising and Potts models, which includes independent sets and graph colorings.
For graph colorings, corresponding to $H = K_q$, we show that the triangle-free hypothesis on $G$ may be dropped; this is also valid if some of the vertices of $K_q$ are looped. A corollary is that among $d$-regular graphs, $G = K_{d,d}$ maximizes the quantity $c_q(G)^{1/|V(G)|}$ for every $q$ and $d$, where $c_q(G)$ counts proper $q$-colorings of $G$.
Finally, we show that if the edge-weight matrix of $H$ is positive semidefinite, then \[ \hom(G, H) \le \prod_{v \in V(G)} \hom(K_{d_v+1}, H )^{1/(d_v+1)}. \] This implies that among $d$-regular graphs, $G = K_{d+1}$ maximizes $\hom(G, H)^{1/|V(G)|}$. For 2-spin Ising models, our results give a complete characterization of extremal graphs: complete bipartite graphs maximize the partition function of 2-spin antiferromagnetic models and cliques maximize the partition function of ferromagnetic models.
These results settle a number of conjectures by Galvin-Tetali, Galvin, and Cohen-Csikvári-Perkins-Tetali, and provide an alternate proof to a conjecture by Kahn.
Arctic Curves in path models from the Tangent Method
Published
• View Publication
• BIB
Recently, Colomo and Sportiello introduced a powerful method, known as the \emph{Tangent Method}, for computing the arctic curve in statistical models which have a (non- or weakly-) intersecting lattice path formulation. We apply the Tangent Method to compute arctic curves in various models: the domino tiling of the Aztec diamond for which we recover the celebrated arctic circle; a model of Dyck paths equivalent to the rhombus tiling of a half-hexagon for which we find an arctic half-ellipse; another rhombus tiling model with an arctic parabola; the vertically symmetric alternating sign matrices, where we find the same arctic curve as for unconstrained alternating sign matrices. The latter case involves lattice paths that are non-intersecting but that are allowed to have osculating contact points, for which the Tangent Method was argued to still apply. For each problem we estimate the large size asymptotics of a certain one-point function using LU decomposition of the corresponding Gessel-Viennot matrices, and a reformulation of the result amenable to asymptotic analysis.
Counting Markov Equivalence Classes for DAG models on Trees
Published
• View Publication
• BIB
DAG models are statistical models satisfying a collection of conditional independence relations encoded by the nonedges of a directed acyclic graph (DAG) $\mathcal{G}$. Such models are used to model complex cause-effect systems across a variety of research fields. From observational data alone, a DAG model $\mathcal{G}$ is only recoverable up to Markov equivalence. Combinatorially, two DAGs are Markov equivalent if and only if they have the same underlying undirected graph (i.e. skeleton) and the same set of the induced subDAGs $i\to j \leftarrow k$, known as immoralities. Hence it is of interest to study the number and size of Markov equivalence classes (MECs). In a recent paper, the authors introduced a pair of generating functions that enumerate the number of MECs on a fixed skeleton by number of immoralities and by class size, and they studied the complexity of computing these functions. In this paper, we lay the foundation for studying these generating functions by analyzing their structure for trees and other closely related graphs. We describe these polynomials for some important families of graphs including paths, stars, cycles, spider graphs, caterpillars, and complete binary trees. In doing so, we recover important connections to independence polynomials, and extend some classical identities that hold for Fibonacci numbers. We also provide tight lower and upper bounds for the number and size of MECs on any tree. Finally, we use computational methods to show that the number and distribution of high degree nodes in a triangle-free graph dictates the number and size of MECs.
Nesting statistics in the O(n) loop model on random planar maps
Published in Commun. Math. Phys. 404, 1125-1229 (2023)
• View Publication
• BIB
In the O(n) loop model on random planar maps, we study the depth - in terms of the number of levels of nesting - of the loop configuration, by means of analytic combinatorics. We focus on the 'refined' generating series of pointed disks or cylinders, which keep track of the number of loops separating the marked point from the boundary (for disks), or the two boundaries (for cylinders). For the general O(n) loop model, we show that these generating series satisfy functional relations obtained by a modification of those satisfied by the unrefined generating series. In a more specific O(n) model where loops cross only triangles and have a bending energy, we explicitly compute the refined generating series. We analyse their non generic critical behavior in the dense and dilute phases, and obtain the large deviations function of the nesting distribution, which is expected to be universal. Using the framework of Liouville quantum gravity (LQG), we show that a rigorous functional KPZ relation can be applied to the multifractal spectrum of extreme nesting in the conformal loop ensemble (CLE) in the Euclidean unit disk, as obtained by Miller, Watson and Wilson, or to its natural generalisation to the Riemann sphere. It allows us to recover the large deviations results obtained for the critical O(n) random planar map models. This offers, at the refined level of large deviations theory, a rigorous check of the fundamental fact that the universal scaling limits of random planar map models as weighted by partition functions of critical statistical models are given by LQG random surfaces decorated by independent CLEs.
A survey of discrete methods in (algebraic) statistics for networks
Sampling algorithms, hypergraph degree sequences, and polytopes play a crucial role in statistical analysis of network data. This article offers a brief overview of open problems in this area of discrete mathematics from the point of view of a particular family of statistical models for networks called exponential random graph models. The problems and underlying constructions are also related to well-known concepts in commutative algebra and graph-theoretic concepts in computer science. We outline a few lines of recent work that highlight the natural connection between these fields and unify them into some open problems. While these problems are often relevant in discrete mathematics in their own right, the emphasis here is on statistical relevance with the hope that these lines of research do not remain disjoint. Suggested specific open problems and general research questions should advance algebraic statistics theory as well as applied statistical tools for rigorous statistical analysis of networks.
A Statistical Model of Current Loops and Magnetic Monopoles
Published in Mathematical Physics, Analysis and Geometry (2015), Volume 18, Issue 1, Article 16
• View Publication
• BIB
We formulate a natural model of current loops and magnetic monopoles for arbitrary planar graphs, which we call the monopole-dimer model, and express the partition function of this model as a determinant. We then extend the method of Kasteleyn and Temperley-Fisher to calculate the partition function exactly in the case of rectangular grids. This partition function turns out to be a square of the partition function of an emergent monomer-dimer model when the grid sizes are even. We use this formula to calculate the local monopole density, free energy and entropy exactly. Our technique is a novel determinantal formula for the partition function of a model of vertices and loops for arbitrary graphs.
Positivity for Gaussian graphical models
Published
• View Publication
• BIB
Gaussian graphical models are parametric statistical models for jointly normal random variables whose dependence structure is determined by a graph. In previous work, we introduced trek separation, which gives a necessary and sufficient condition in terms of the graph for when a subdeterminant is zero for all covariance matrices that belong to the Gaussian graphical model. Here we extend this result to give explicit cancellation-free formulas for the expansions of nonzero subdeterminants.
Combinatorial degree bound for toric ideals of hypergraphs
Published
• View Publication
• BIB
Associated to any hypergraph is a toric ideal encoding the algebraic relations among its edges. We study these ideals and the combinatorics of their minimal generators, and derive general degree bounds for both uniform and non-uniform hypergraphs in terms of balanced hypergraph bicolorings, separators, and splitting sets. In turn, this provides complexity bounds for algebraic statistical models associated to hypergraphs. As two main applications, we recover a well-known complexity result for Markov bases of arbitrary 3-way tables, and we show that the defining ideal of the tangential variety is generated by quadratics and cubics in cumulant coordinates.
Toric algebra of hypergraphs
The edges of any hypergraph parametrize a monomial algebra called the edge subring of the hypergraph. We study presentation ideals of these edge subrings, and describe their generators in terms of balanced walks on hypergraphs. Our results generalize those for the defining ideals of edge subrings of graphs, which are well-known in the commutative algebra community, and popular in the algebraic statistics community. One of the motivations for studying toric ideals of hypergraphs comes from algebraic statistics, where generators of the toric ideal give a basis for random walks on fibers of the statistical model specified by the hypergraph. Further, understanding the structure of the generators gives insight into the model geometry.
Markov Bases for Typical Block Effect Models of Two-way Contingency Tables
Published in Journal of Multivariate Analysis 112 (2012) 219--229
• View Publication
• BIB
Markov basis for statistical model of contingency tables gives a useful tool for performing the conditional test of the model via Markov chain Monte Carlo method. In this paper we derive explicit forms of Markov bases for change point models and block diagonal effect models, which are typical block-wise effect models of two-way contingency tables, and perform conditional tests with some real data sets.
A note on statistical model for BPS D4-D2-D0 states
Published
• View Publication
• BIB
We construct a statistical model that reproduces the BPS partition function of D4-D2-D0 bound states on a class of toric Calabi-Yau three-folds. The Calabi-Yau three-folds we consider are obtained by adding a compact two-cycle to $A_{N-1}$-ALE $\times \mathbb{C}$. We show that in the small radii limit of the Calabi-Yau the D4-D2-D0 partition function is correctly reproduced by counting the number of triangles and parallelograms.
Statistical model and BPS D4-D2-D0 counting
Published in JHEP 1105:072,2011
• View Publication
• BIB
We construct a statistical model that correctly reproduces the BPS partition function of D4-D2-D0 bound states on the resolved conifold. We prove that the known partition function of the BPS indices is reproduced by the counting "triangular partitions" problem. The wall-crossing phenomena in our model are also studied.
L-cumulants, L-cumulant embeddings and algebraic statistics
Published
• View Publication
• BIB
Focusing on the discrete probabilistic setting we generalize the combinatorial definition of cumulants to L-cumulants. This generalization keeps all the desired properties of the classical cumulants like semi-invariance and vanishing for independent blocks of random variables. These properties make L-cumulants useful for the algebraic analysis of statistical models. We illustrate this for general Markov models and hidden Markov processes in the case when the hidden process is binary. The main motivation of this work is to understand cumulant-like coordinates in algebraic statistics and to give a more insightful explanation why tree cumulants give such an elegant description of binary hidden tree models. Moreover, we argue that L-cumulants can be used in the analysis of certain classical algebraic varieties.
Perturbation of matrices and non-negative rank with a view toward statistical models
Published
• View Publication
• BIB
In this paper we study how perturbing a matrix changes its non-negative rank. We prove that the non-negative rank is upper-semicontinuos and we describe some special families of perturbations. We show how our results relate to Statistics in terms of the study of Maximum Likelihood Estimation for mixture models.
An Implicitization Challenge for Binary Factor Analysis
Published in J. Symbolic Comput. 45 (2010), no. 12, 1296--1315
• View Publication
• BIB
We use tropical geometry to compute the multidegree and Newton polytope of the hypersurface of a statistical model with two hidden and four observed binary random variables, solving an open question stated by Drton, Sturmfels and Sullivant in "Lectures on Algebraic Statistics" (Problem 7.7). The model is obtained from the undirected graphical model of the complete bipartite graph $K_{2,4}$ by marginalizing two of the six binary random variables. We present algorithms for computing the Newton polytope of its defining equation by parallel walks along the polytope and its normal fan. In this way we compute vertices of the polytope. Finally, we also compute and certify its facets by studying tangent cones of the polytope at the symmetry classes vertices. The Newton polytope has 17214912 vertices in 44938 symmetry classes and 70646 facets in 246 symmetry classes.
A tree-decomposed transfer matrix for computing exact Potts model partition functions for arbitrary graphs, with applications to planar graph colourings
Published
• View Publication
• BIB
Combining tree decomposition and transfer matrix techniques provides a very general algorithm for computing exact partition functions of statistical models defined on arbitrary graphs. The algorithm is particularly efficient in the case of planar graphs. We illustrate it by computing the Potts model partition functions and chromatic polynomials (the number of proper vertex colourings using Q colours) for large samples of random planar graphs with up to N=100 vertices. In the latter case, our algorithm yields a sub-exponential average running time of ~ exp(1.516 sqrt(N)), a substantial improvement over the exponential running time ~ exp(0.245 N) provided by the hitherto best known algorithm. We study the statistics of chromatic roots of random planar graphs in some detail, comparing the findings with results for finite pieces of a regular lattice.