convex optimization
41 papers tagged with this keyword
Subexponential Approximation of the Permanent in Deterministic Polynomial Time
We give the first deterministic polynomial time algorithm that approximates the permanent of arbitrary nonnegative rational matrices within a subexponential factor. For a matrix of order $n$, the approximation factor is \[
\exp\!\left(O\!\left(\frac{n(\log\log n)^2}{\log n}\right)\right)=\exp(o(n)). \] All previously known deterministic polynomial time guarantees for unrestricted inputs had approximation factors $\exp(Ω(n))$.
Our proof uses convex optimization to tighten an upper bound on the permanent. The bound is based on weighted sums over all matchings in a bipartite graph representing the matrix, and correlations between unmatched vertices control its error. We approximate these sums deterministically using correlation decay and a bound on the effect of vertex deletion.
The edge of the asymptotic spectrum of tensors
Strassen founded the theory of the asymptotic spectrum of tensors to study the complexity of matrix multiplication. A central challenge in this theory is to explicitly construct new spectral points. In Crelle 1991, Strassen proposed the upper support functionals $ζ^θ$ as candidate spectral points, where $θ$ ranges over a triangle $Θ$. Recent progress, involving tools and ideas from quantum information theory (Christandl-Vrana-Zuiddam, STOC 2018, JAMS 2021) and convex optimization (Hirai, 2025), culminated in the proof that the upper support functionals are indeed spectral points over the complex numbers (Sakabe-Doğan-Walter, 2026).
In this paper, we give an even clearer picture of the situation for support functionals when $θ$ lies along the edges of the triangle. We show that not only are these functionals spectral points, but that they are uniquely determined as spectral points by their behavior on matrix multiplication tensors. As our methods are algebraic, as a corollary this establishes for the first time the existence of nontrivial spectral points over arbitrary fields.
As part of our argument, we show a close connection between the edge support functionals and Harder-Narasimhan filtrations from quiver representation theory. We thus show, using recent work in algorithmic invariant theory, that these support functionals can be computed in deterministic polynomial time. Other ingredients of our proof include a new criterion for abstractly characterizing asymptotic tensor ranks by spectral points, and a characterization of the edge support functionals in terms of matrix multiplication capacity. As another application of these tools, we prove the existence of spectral points for higher-mode tensors beyond those currently known.
Maximum spectral sum of graphs
For a graph $G$ of order $n$, the spectral sum of $G$ is defined to be the sum $λ_1(G) + λ_2(G)$, where $λ_1(G)$ (resp. $λ_2(G)$) is the largest (resp. second largest) adjacency eigenvalue of $G$. Ebrahimi, Mohar, Nikiforov and Ahmady (2008) conjectured that the spectral sum \[ λ_1(G) + λ_2(G)\le \frac{8}{7}n \] for any graph $G$. We prove this conjecture by combining tools from the theory of graph limits, convex geometry, exterior algebra and convex optimization. The techniques developed are of independent interest.
Separable convex optimization over indegree polytopes
We study egalitarian (acyclic) orientations of undirected graphs under indegree-based objectives, such as minimizing the $\varphi$-sum of indegrees for a strictly convex function $\varphi$, decreasing minimization (dec-min), and increasing maximization (inc-max). In the non-acyclic setting of Frank and Murota (2022), a single orientation simultaneously optimizes these three objectives, however, restricting to acyclic orientations confines us to the corners of the indegree polytope, where these fairness objectives do diverge. We establish strong hardness results across a broad range of settings: minimizing the $\varphi$-sum of indegrees is NP-hard for every discrete strictly convex function $\varphi$; dec-min and inc-max are NP-hard for every indegree bound $k \geq 2$, as well as without a bound; and the complementary inc-min and dec-max problems are NP-hard even on $3$-regular graphs. On the algorithmic side, we give a polynomial-time algorithm for minimizing the maximum weighted indegree via a weighted smallest-last ordering. We also provide an exact exponential-time algorithm for minimizing general separable discrete convex objectives over indegrees, and a polynomial-time algorithm for the non-acyclic case. Finally, for maximizing the sum of the products of indegrees and outdegrees, we prove NP-hardness on graphs of maximum degree $4$, give an algorithm for maximum degree $3$, and provide a $3$-approximation algorithm. Our results delineate the algorithmic frontier of convex integral optimization over indegree (base-)polytopes, and highlight both theoretical consequences and practical implications, notably for scheduling and deadlock-free routing.
Approximating mixed volumes to arbitrary accuracy
We study the problem of approximating the mixed volume $V(P_1^{(α_1)}, \dots, P_k^{(α_k)})$ of an $k$-tuple of convex polytopes $(P_1, \dots, P_k)$, each of which is defined as the convex hull of at most $m_0$ points in $\mathbb{Z}^n$. We design an algorithm that produces an estimate that is within a multiplicative $1 \pm ε$ factor of the true mixed volume with a probability greater than $1 - δ.$ Let the constant $ \prod_{i=2}^{k} \frac{(α_{i}+1)^{α_{i}+1}}{α_{i}^{\,α_{i}}}$ be denoted by $\tilde{A}$. When each $P_i \subseteq B_\infty(2^L)$, we show in this paper that the time complexity of the algorithm is bounded above by a polynomial in $n, m_0, L, \tilde{A}, ε^{-1}$ and $\log δ^{-1}$. In fact, a stronger result is proved in this paper, with slightly more involved terminology.
In particular, we provide the first randomized polynomial time algorithm for computing mixed volumes of such polytopes when $k$ is an absolute constant, but $α_1, \dots, α_k$ are arbitrary. Our approach synthesizes tools from convex optimization, the theory of Lorentzian polynomials, and polytope subdivision.
Fast exact recovery of noisy matrix from few entries: the infinity norm approach
The matrix recovery (completion) problem, a central problem in data science and theoretical computer science, is to recover a matrix $A$ from a relatively small sample of entries.
While such a task is impossible in general, it has been shown that one can recover $A$ exactly in polynomial time, with high probability, from a random subset of entries, under three (basic and necessary) assumptions: (1) the rank of $A$ is very small compared to its dimensions (low rank), (2) $A$ has delocalized singular vectors (incoherence), and (3) the sample size is sufficiently large.
There are many different algorithms for the task, including convex optimization by Candes, Tao and Recht (2009), alternating projection by Hardt and Wooters (2014) and low rank approximation with gradient descent by Keshavan, Montanari and Oh (2009, 2010).
In applications, it is more realistic to assume that data is noisy. In this case, these approaches provide an approximate recovery with small root mean square error. However, it is hard to transform such an approximate recovery to an exact one.
Recently, results by Abbe et al. (2017) and Bhardwaj et al. (2023) concerning approximation in the infinity norm showed that we can achieve exact recovery even in the noisy case, given that the ground matrix has bounded precision. Beyond the three basic assumptions above, they required either the condition number of $A$ is small (Abbe et al.) or the gap between consecutive singular values is large (Bhardwaj et al.).
In this paper, we remove these extra spectral assumptions. As a result, we obtain a simple algorithm for exact recovery in the noisy case, under only the three basic assumptions. This is the first such algorithm. To analyse this algorithm, we introduce a contour integration argument which is totally different from all previous methods and may be of independent interest.
Coupling and Tensorization of Kinetic Theory and Graph Theory
We study a non-exchangeable multi-agent system and rigorously derive a strong form of the mean-field limit. The convergence of the connection weights and the initial data implies convergence of large-scale dynamics toward a deterministic limit given by the corresponding extended Vlasov PDE, at any later time and any realization of randomness. This is established on what we call a bi-coupling distance defined through a convex optimization problem, which is an interpolation of the optimal transport between measures and the fractional overlay between graphs. The proof relies on a quantitative stability estimate of the so-called observables, which are tensorizations of agent laws and graph homomorphism densities. This reveals a profound relationship between mean-field theory and graph limiting theory, intersecting in the study of non-exchangeable systems.
Deterministic Approximation Algorithms for Volumes of Spectrahedra
We give a method for computing asymptotic formulas and approximations for the volumes of spectrahedra, based on the maximum-entropy principle from statistical physics. The method gives an approximate volume formula based on a single convex optimization problem of minimizing $-\log \det P$ over the spectrahedron. Spectrahedra can be described as affine slices of the convex cone of positive semi-definite (PSD) matrices, and the method yields efficient deterministic approximation algorithms and asymptotic formulas whenever the number of affine constraints is sufficiently dominated by the dimension of the PSD cone.
Our approach is inspired by the work of Barvinok and Hartigan who used an analogous framework for approximately computing volumes of polytopes. Spectrahedra, however, possess a remarkable feature not shared by polytopes, a new fact that we also prove: central sections of the set of density matrices (the quantum version of the simplex) all have asymptotically the same volume. This allows for very general approximation algorithms, which apply to large classes of naturally occurring spectrahedra.
We give two main applications of this method. First, we apply this method to what we call the "multi-way Birkhoff spectrahedron" and obtain an explicit asymptotic formula for its volume. This spectrahedron is the set of quantum states with maximal entanglement (i.e., the quantum states having univariant quantum marginals equal to the identity matrix) and is the quantum analog of the multi-way Birkhoff polytope. Second, we apply this method to explicitly compute the asymptotic volume of central sections of the set of density matrices.
Bounds on the Higher Degree Erdős-Ginzburg-Ziv Constants over $\mathbb{F}_q^n$
Published
• View Publication
• BIB
The classical Erdős-Ginzburg-Ziv constant of a group $G$ denotes the smallest positive integer $\ell$ such that any sequence $S$ of length at least $\ell$ contains a zero-sum subsequence of length $\exp(G)$.
In a recent paper, Caro and Schmitt generalized this concept, using the $m$-th degree symmetric polynomial $e_m(S)$ instead of the sum of the elements of $S$ and considering subsequences of a given length $t$. In particular, they defined the higher degree Erdős-Ginzburg-Ziv constants $EGZ(t,R,m)$ of a finite commutative ring $R$ and presented several lower and upper bounds to these constants.
This paper aims to provide lower and upper bounds for $EGZ(t,R,m)$ in case $R=\mathbb{F}_q^{n}$. The lower bounds here presented have been obtained, respectively, using Lovász Local Lemma and the Expurgation method and, for sufficiently large $n$, they beat the lower bound provided by Caro and Schmitt for the same kind of rings. Finally, we prove closed form upper bounds derived from the Ellenberg-Gijswijt and Sauermann results for the cap-set problem assuming that $q = p^k$, $t = p$, and $m=p-1$. Moreover, using the Slice Rank method we derive a convex optimization problem that provides the best bounds for $q = 3^k$, $t = 3$, $m=2$ and $k=2,3,4,5$.
Bounding the number of odd paths in planar graphs via convex optimization
Published
• View Publication
• BIB
Let $N_{\mathcal{P}}(n,H)$ denote the maximum number of copies of $H$ in an $n$ vertex planar graph. The problem of bounding this function for various graphs $H$ has been extensively studied since the 70's. A special case that received a lot of attention recently is when $H$ is the path on $2m+1$ vertices, denoted $P_{2m+1}$. Our main result in this paper is that $$ N_{\mathcal{P}}(n,P_{2m+1})=O(m^{-m}n^{m+1})\;.$$ This improves upon the previously best known bound by a factor $e^{m}$, which is best possible up to the hidden constant, and makes a significant step towards resolving conjectures of Gosh et al. and of Cox and Martin. The proof uses graph theoretic arguments together with (simple) arguments from the theory of convex optimization.
Erdős' minimum overlap problem
Published
• View Publication
• BIB
We obtain a substantially improved lower bound for the minimum overlap problem asked by Erdős. Our approach uses elementary Fourier analysis to translate the problem to a convex optimization program.
No self-concordant barrier interior point method is strongly polynomial
Published
• View Publication
• BIB
It is an open question to determine if the theory of self-concordant barriers can provide an interior point method with strongly polynomial complexity in linear programming. In the special case of the logarithmic barrier, it was shown in [Allamigeon, Benchimol, Gaubert and Joswig, SIAM J. on Applied Algebra and Geometry, 2018] that the answer is negative. In this paper, we show that none of the self-concordant barrier interior point methods is strongly polynomial. This result is obtained by establishing that, on parametric families of convex optimization problems, the log-limit of the central path degenerates to a piecewise linear curve, independently of the choice of the barrier function. We provide an explicit linear program that falls in the same class as the Klee-Minty counterexample, i.e., in dimension $n$ with $2n$ constraints, in which the number of iterations is $Ω(2^n)$.
Computing Tighter Bounds on the $n$-Queens Constant via Newton's Method
Published in Optimization Letters 17, 1229-1240 (2023)
• View Publication
• BIB
In recent work Simkin shows that bounds on an exponent occurring in the famous $n$-queens problem can be evaluated by solving convex optimization problems, allowing him to find bounds far tighter than previously known. In this note we use Simkin's formulation, a sharper bound developed by Knuth, and a Newton method that scales to large problem instances, to find even sharper bounds.
The number of $n$-queens configurations
Published
• View Publication
• BIB
The $n$-queens problem is to determine $\mathcal{Q}(n)$, the number of ways to place $n$ mutually non-threatening queens on an $n \times n$ board. We show that there exists a constant $α= 1.942 \pm 3 \times 10^{-3}$ such that $\mathcal{Q}(n) = ((1 \pm o(1))ne^{-α})^n$. The constant $α$ is characterized as the solution to a convex optimization problem in $\mathcal{P}([-1/2,1/2]^2)$, the space of Borel probability measures on the square.
The chief innovation is the introduction of limit objects for $n$-queens configurations, which we call queenons. These form a convex set in $\mathcal{P}([-1/2,1/2]^2)$. We define an entropy function that counts the number of $n$-queens configurations that approximate a given queenon. The upper bound uses the entropy method of Radhakrishnan and Linial--Luria. For the lower bound we describe a randomized algorithm that constructs a configuration near a prespecified queenon and whose entropy matches that found in the upper bound. The enumeration of $n$-queens configurations is then obtained by maximizing the (concave) entropy function in the space of queenons.
Along the way we prove a large deviations principle for $n$-queens configurations that can be used to study their typical structure.
Discrete-to-Continuous Extensions: Lovász extension, optimizations and eigenvalue problems
In this paper, we use various versions of Lovász extension to systematically derive continuous formulations of problems from discrete mathematics. This will take place in the following context:
(1) For combinatorial optimization problems in quotient form, we systematically develop equivalent continuous versions, thereby making tools from convex optimization, fractional programming and more general continuous algorithms like the stochastic subgradient method available for such optimization problems.
(2) For some combinatorial quantities like Cheeger-type constants, we suggest a nonlinear eigenvalue problem for a pair of Lovász extensions of certain functions, which encodes certain combinatorial structures.
This theory has several applications to quantitative and combinatorial problems, including:
(a) The equivalent continuous representations for the max $k$-cut problem, various Cheeger sets and isoperimetric constants are constructed. This also initiates a study of Dirichlet and Neumann 1-Laplacians on graphs, in which the nodal domain property and Cheeger-type equalities are presented.
(b) Also, we derive a new equivalent continuous representation of the graph independence number, which can be compared with the Motzkin-Straus theorem. More importantly, an equivalent continuous optimization for the chromatic number is provided, which seems to be the first continuous representation of the graph vertex coloring number. We provide the first continuous reformulation of the frustration index in signed networks, and we find a connection to the so-called modularity measure. Graph matching numbers, submodular vertex covers and multiway partition problems can also be studied in this framework.
Conic-Optimization Based Algorithms for Nonnegative Matrix Factorization
Published in Optimization Methods and Software 38 (4), pp. 837-859, 2023
• View Publication
• BIB
Nonnegative matrix factorization is the following problem: given a nonnegative input matrix $V$ and a factorization rank $K$, compute two nonnegative matrices, $W$ with $K$ columns and $H$ with $K$ rows, such that $WH$ approximates $V$ as well as possible. In this paper, we propose two new approaches for computing high-quality NMF solutions using conic optimization. These approaches rely on the same two steps. First, we reformulate NMF as minimizing a concave function over a product of convex cones--one approach is based on the exponential cone, and the other on the second-order cone. Then, we solve these reformulations iteratively: at each step, we minimize exactly, over the feasible set, a majorization of the objective functions obtained via linearization at the current iterate. Hence these subproblems are convex conic programs and can be solved efficiently using dedicated algorithms. We prove that our approaches reach a stationary point with an accuracy decreasing as $\mathcal{O}(\frac{1}{i})$, where $i$ denotes the iteration number. To the best of our knowledge, our analysis is the first to provide a convergence rate to stationary points for NMF. Furthermore, in the particular cases of rank-one factorizations (that is, $K=1$), we show that one of our formulations can be expressed as a convex optimization problem implying that optimal rank-one approximations can be computed efficiently. Finally, we show on several numerical examples that our approaches are able to frequently compute exact NMFs (that is, with $V = WH$), and compete favorably with the state of the art.
Graph Similarity and Homomorphism Densities
We introduce the tree distance, a new distance measure on graphs. The tree distance can be computed in polynomial time with standard methods from convex optimization. It is based on the notion of fractional isomorphism, a characterization based on a natural system of linear equations whose integer solutions correspond to graph isomorphism. By results of Tinhofer (1986, 1991) and Dvořák (2010), two graphs G and H are fractionally isomorphic if and only if, for every tree T, the number of homomorphisms from T to G equals the corresponding number from T to H, which means that the tree distance of G and H is zero. Our main result is that this correspondence between the equivalence relations "fractional isomorphism" and "equal tree homomorphism densities" can be extended to a correspondence between the associated distance measures. Our result is inspired by a similar result due to Lovász and Szegedy (2006) and Borgs, Chayes, Lovász, Sós, and Vesztergombi (2008) that connects the cut distance of graphs to their homomorphism densities (over all graphs), which is a fundamental theorem in the theory of graph limits. We also introduce the path distance of graphs and take the corresponding result of Dell, Grohe, and Rattan (2018) for exact path homomorphism counts to an approximate level. Our results answer an open question of Grohe (2020).
We establish our main results by generalizing our definitions to graphons as this allows us to apply techniques from functional analysis. We prove the fairly general statement that, for every "reasonably" defined graphon pseudometric, an exact correspondence to homomorphism densities can be turned into an approximate one. We also provide an example of a distance measure that violates this reasonableness condition. This incidentally answers an open question of Grebík and Rocha (2021).
Barriers for recent methods in geodesic optimization
Published
• View Publication
• BIB
We study a class of optimization problems including matrix scaling, matrix balancing, multidimensional array scaling, operator scaling, and tensor scaling that arise frequently in theory and in practice. Some of these problems, such as matrix and array scaling, are convex in the Euclidean sense, but others such as operator scaling and tensor scaling are geodesically convex on a different Riemannian manifold. Trust region methods, which include box-constrained Newton's method, are known to produce high precision solutions very quickly for matrix scaling and matrix balancing (Cohen et. al., FOCS 2017, Allen-Zhu et. al. FOCS 2017), and result in polynomial time algorithms for some geodesically convex problems like operator scaling (Garg et. al. STOC 2018, Bürgisser et. al. FOCS 2019). One is led to ask whether these guarantees also hold for multidimensional array scaling and tensor scaling.
We show that this is not the case by exhibiting instances with exponential diameter bound: we construct polynomial-size instances of 3-dimensional array scaling and 3-tensor scaling whose approximate solutions all have doubly exponential condition number. Moreover, we study convex-geometric notions of complexity known as margin and gap, which are used to bound the running times of all existing optimization algorithms for such problems. We show that margin and gap are exponentially small for several problems including array scaling, tensor scaling and polynomial scaling. Our results suggest that it is impossible to prove polynomial running time bounds for tensor scaling based on diameter bounds alone. Therefore, our work motivates the search for analogues of more sophisticated algorithms, such as interior point methods, for geodesically convex optimization that do not rely on polynomial diameter bounds.
Maximum entropy and integer partitions
Published
• View Publication
• BIB
We derive asymptotic formulas for the number of integer partitions with given sums of $j$th powers of the parts for $j$ belonging to a finite, non-empty set $J \subset \mathbb N$. The method we use is based on the `principle of maximum entropy' of Jaynes. This principle leads to an intuitive variational formula for the asymptotics of the logarithm of the number of constrained partitions as the solution to a convex optimization problem over real-valued functions.
Scalable Semidefinite Programming
Published in SIAM Journal on Mathematics of Data Science, vol. 3, num. 1, pp. 171-200, Feb. 2021
• View Publication
• BIB
Semidefinite programming (SDP) is a powerful framework from convex optimization that has striking potential for data science applications. This paper develops a provably correct randomized algorithm for solving large, weakly constrained SDP problems by economizing on the storage and arithmetic costs. Numerical evidence shows that the method is effective for a range of applications, including relaxations of MaxCut, abstract phase retrieval, and quadratic assignment. Running on a laptop equivalent, the algorithm can handle SDP instances where the matrix variable has over $10^{14}$ entries.