arXiv++ Combinatorics

Let $G$ be a complex classical group, and let $V$ be its defining representation (possibly plus a copy of the dual). A foundational problem in classical invariant theory is to write down generators and relations for the ring of $G$-invariant polynomial functions on the space $\mathcal{P}^m(V)$ of degree-$m$ homogeneous polynomial functions on $V$. In this paper, we replace $\mathcal{P}^m(V)$ with the full polynomial algebra $\mathcal{P}(V)$. As a result, the invariant ring is no longer finitely generated. Hence instead of seeking generators, we aim to write down linear bases for bigraded components. Indeed, when $G$ is of sufficiently high rank, we realize these bases as sets of graphs with prescribed number of vertices and edges. When the rank of $G$ is small, there arise complicated linear dependencies among the graphs, but we remedy this setback via representation theory: in particular, we determine the dimension of an arbitrary component in terms of branching multiplicities from the general linear group to the symmetric group. We thereby obtain an expression for the bigraded Hilbert series of the ring of invariants on $\mathcal{P}(V)$. We conclude with examples using our graphical notation, several of which recover classical results.

We consider two natural statistics on pairs of histograms, in which the $n$ bins have weights $0, \ldots, n-1$. The difference ($\mathbf{D}$) between the weighted totals of the histograms is, in a sense, refined by the earth mover's distance ($\mathbf{EMD}$), which measures the amount of work required to equalize the histograms. We were recently surprised, however, by how little $\mathbf{EMD}$ actually does refine $\mathbf{D}$ in certain real-world applications, which led to the main problem in this paper: what is the probability that $\mathbf{EMD} = |\mathbf{D}|$? We derive a formula for this probability, as well as the expected value of $|\mathbf{D}|$, via the combinatorics of Young diagrams and plane partitions. We then generalize our results to an arbitrary number of histograms, where we realize this higher-dimensional $\mathbf{D}$ as distance on the Type-A root lattice.

The earth mover's distance (EMD), also called the first Wasserstein distance, can be naturally extended to compare arbitrarily many probability distributions, rather than only two, on the set $[n]=\{1,\dots,n\}$. We present the details for this generalization, along with a highly efficient algorithm inspired by combinatorics; it turns out that in the special case of three distributions, the EMD is half the sum of the pairwise EMD's. Extending the methods of Bourn and Willenbring (arXiv:1903.03673), we compute the expected value of this generalized EMD on random $d$-tuples of distributions, using a generating function which coincides with the Hilbert series of the Segre embedding. We then use the EMD to analyze a real-world data set of grade distributions.