arXiv++ Combinatorics

Shifted combinatorial optimization is a new nonlinear optimization framework, which is a broad extension of standard combinatorial optimization, involving the choice of several feasible solutions at a time. It captures well studied and diverse problems ranging from congestive to partitioning problems. In particular, every standard combinatorial optimization problem has its shifted counterpart, which is typically much harder. Here we initiate a study of approximation algorithms for this broad optimization framework.

Shifted combinatorial optimization is a new nonlinear optimization framework which is a broad extension of standard combinatorial optimization, involving the choice of several feasible solutions at a time. This framework captures well studied and diverse problems ranging from so-called vulnerability problems to sharing and partitioning problems. In particular, every standard combinatorial optimization problem has its shifted counterpart, which is typically much harder. Already with explicitly given input set the shifted problem may be NP-hard. In this article we initiate a study of the parameterized complexity of this framework. First we show that shifting over an explicitly given set with its cardinality as the parameter may be in XP, FPT or P, depending on the objective function. Second, we study the shifted problem over sets definable in MSO logic (which includes, e.g., the well known MSO partitioning problems). Our main results here are that shifted combinatorial optimization over MSO definable sets is in XP with respect to the MSO formula and the treewidth (or more generally clique-width) of the input graph, and is W[1]-hard even under further severe restrictions.

We introduce and study a family of polytopes which can be seen as a generalization of the permutahedron of type $B_d$. We highlight connections with the largest possible diameter of the convex hull of a set of points in dimension $d$ whose coordinates are integers between $0$ and $k$, and with the computational complexity of multicriteria matroid optimization.

The three-way table problem is to decide if there exists an l x m x n table satisfying given line sums, and find a table if there is one. It is NP-complete already for l=3 and every bounded integer program can be isomorphically represented in polynomial time for some m and n as some 3 x m x n table problem. Recently, the problem was shown to be fixed-parameter tractable with parameters l,m. Here we extend this and show that the huge version of the problem, where the variable side n is a huge number encoded in binary, is also fixed-parameter tractable with parameters l,m. We also conclude that the huge multicommodity flow problem with m suppliers and a huge number n of consumers is fixed-parameter tractable parameterized by the numbers of commodities and consumer types. One of our tools is a theorem about unimodular monoids which is of interest on its own right. The monoid problem is to decide if a given integer vector is a finite nonnegative integer combination of a given set of integer vectors, and find such a decomposition if one exists. We consider sets given implicitly by an inequality system. For such sets, it was recently shown that in fixed dimension the problem is solvable in polynomial time with degree which is exponential in the dimension. Here we show that when the inequality system which defines the set is defined by a totally unimodular matrix, the monoid problem can be solved in polynomial time even in variable dimension.

We show that finding lexicographically minimal $n$ bases in a matroid can be done in polynomial time in the oracle model. This follows from a more general result that the shifted problem over a matroid can be solved in polynomial time as well.

We show that finding minimally intersecting $n$ paths from $s$ to $t$ in a directed graph or $n$ perfect matchings in a bipartite graph can be done in polynomial time. This holds more generally for unimodular set systems.

Optimization over $l\times m\times n$ integer $3$-way tables with given line-sums is NP-hard already for fixed $l=3$, but is polynomial time solvable with both $l,m$ fixed. In the {\em huge} version of the problem, the variable dimension $n$ is encoded in {\em binary}, with $t$ {\em layer types}. It was recently shown that the huge problem can be solved in polynomial time for fixed $t$, and the complexity of the problem for variable $t$ was raised as an open problem. Here we solve this problem and show that the huge table problem can be solved in polynomial time even when the number $t$ of types is {\em variable}. The complexity of the problem over $4$-way tables with variable $t$ remains open. Our treatment goes through the more general class of {\em huge $n$-fold integer programming problems}. We show that huge integer programs over $n$-fold products of totally unimodular matrices can be solved in polynomial time even when the number $t$ of brick types is variable.

Deciding the existence of an $l\times m\times n$ integer threeway table with given line-sums is NP-complete already for fixed $l=3$, but is in P with both $l,m$ fixed. Here we consider {\em huge} tables, where the variable dimension $n$ is encoded in {\em binary}. Combining recent results on integer cones and Graver bases, we show that if the number of {\em layer types} is fixed, then the problem is in P, whereas if it is variable, then the problem is in NP intersect coNP. Our treatment goes through the more general class of $n$-fold integer programming problems.

We provide a complexity classification of four variants of robust integer programming when the underlying Graver basis is given. We discuss applications to robust multicommodity flows and multidimensional transportation, and describe an effective parametrization of robust integer programming.

In this article we study convex integer maximization problems with composite objective functions of the form $f(Wx)$, where $f$ is a convex function on $\R^d$ and $W$ is a $d\times n$ matrix with small or binary entries, over finite sets $S\subset \Z^n$ of integer points presented by an oracle or by linear inequalities. Continuing the line of research advanced by Uri Rothblum and his colleagues on edge-directions, we introduce here the notion of {\em edge complexity} of $S$, and use it to establish polynomial and constant upper bounds on the number of vertices of the projection $\conv(WS)$ and on the number of linear optimization counterparts needed to solve the above convex problem. Two typical consequences are the following. First, for any $d$, there is a constant $m(d)$ such that the maximum number of vertices of the projection of any matroid $S\subset\{0,1\}^n$ by any binary $d\times n$ matrix $W$ is $m(d)$ regardless of $n$ and $S$; and the convex matroid problem reduces to $m(d)$ greedily solvable linear counterparts. In particular, $m(2)=8$. Second, for any $d,l,m$, there is a constant $t(d;l,m)$ such that the maximum number of vertices of the projection of any three-index $l\times m\times n$ transportation polytope for any $n$ by any binary $d\times(l\times m\times n)$ matrix $W$ is $t(d;l,m)$; and the convex three-index transportation problem reduces to $t(d;l,m)$ linear counterparts solvable in polynomial time.

Given a set of integers W, the Partition problem determines whether W can be divided into two disjoint subsets with equal sums. We model the Partition problem as a system of polynomial equations, and then investigate the complexity of a Hilbert's Nullstellensatz refutation, or certificate, that a given set of integers is not partitionable. We provide an explicit construction of a minimum-degree certificate, and then demonstrate that the Partition problem is equivalent to the determinant of a carefully constructed matrix called the partition matrix. In particular, we show that the determinant of the partition matrix is a polynomial that factors into an iteration over all possible partitions of W.

N-fold integer programming is a fundamental problem with a variety of natural applications in operations research and statistics. Moreover, it is universal and provides a new, variable-dimension, parametrization of all of integer programming. The fastest algorithm for $n$-fold integer programming predating the present article runs in time $O(n^{g(A)}L)$ with $L$ the binary length of the numerical part of the input and $g(A)$ the so-called Graver complexity of the bimatrix $A$ defining the system. In this article we provide a drastic improvement and establish an algorithm which runs in time $O(n^3 L)$ having cubic dependency on $n$ regardless of the bimatrix $A$. Our algorithm can be extended to separable convex piecewise affine objectives as well, and also to systems defined by bimatrices with variable entries. Moreover, it can be used to define a hierarchy of approximations for any integer programming problem.

We consider the nonlinear integer programming problem of minimizing a quadratic function over the integer points in variable dimension satisfying a system of linear inequalities. We show that when the Graver basis of the matrix defining the system is given, and the quadratic function lies in a suitable {\em dual Graver cone}, the problem can be solved in polynomial time. We discuss the relation between this cone and the cone of positive semidefinite matrices, and show that none contains the other. So we can minimize in polynomial time some non-convex and some (including all separable) convex quadrics. We conclude by extending our results to efficient integer minimization of multivariate polynomial functions of arbitrary degree lying in suitable cones.

We consider optimization of nonlinear objective functions that balance $d$ linear criteria over $n$-element independence systems presented by linear-optimization oracles. For $d=1$, we have previously shown that an $r$-best approximate solution can be found in polynomial time. Here, using an extended Erdős-Ko-Rado theorem of Frankl, we show that for $d=2$, finding a $ρn$-best solution requires exponential time.

We overview our recently introduced theory of n-fold integer programming which enables the polynomial time solution of fundamental linear and nonlinear integer programming problems in variable dimension. We demonstrate its power by obtaining the first polynomial time algorithms in several application areas including multicommodity flows and privacy in statistical databases.

The multicommodity flow problem is NP-hard already for two commodities over bipartite graphs. Nonetheless, using our recent theory of n-fold integer programming and extensions developed herein, we are able to establish the surprising polynomial time solvability of the problem in two broad situations.

Inspired by a paper of R. W. Rosenthal, we investigate generalized Nash-equilibria of integer programming games. We show that generalized Nash-equilibria always exist and are related to an optimal solution of a so-called N-fold integer program. This link allows us to establish some polynomial time complexity results about solving this optimization problem and its inverse counter-part.

We address optimization of nonlinear functions of the form $f(Wx)$, where $f:\R^d\to \R$ is a nonlinear function, $W$ is a $d\times n$ matrix, and feasible $x$ are in some large finite set $F$ of integer points in $\R^n$. One motivation is multi-objective discrete optimization, where $f$ trades off the linear functions given by the rows of $W$. Another motivation is to extend known results about polynomial-time linear optimization over discrete structures to nonlinear optimization. We assume that the convex hull of $F$ is well-described by linear inequalities. For example, the set of characteristic vectors of common bases of a pair of matroids on a common ground set. When $F$ is well described, $f$ is convex (or even quasiconvex), and $W$ has a fixed number of rows and is unary encoded or with entries in a fixed set, we give an efficient deterministic algorithm for maximization. When $F$ is well described, $f$ is a norm, and binary-encoded $W$ is nonnegative, we give an efficient deterministic constant-approximation algorithm for maximization. When $F$ is well described, $f$ is ``ray concave'' and non-decreasing, and $W$ has a fixed number of rows and is unary encoded or with entries in a fixed set, we give an efficient deterministic constant-approximation algorithm for minimization. When $F$ is the set of characteristic vectors of common bases of a pair of vectorial matroids on a common ground set, $f$ is arbitrary, and $W$ has a fixed number of rows and is unary encoded, we give an efficient randomized algorithm for optimization.

We consider the problem of optimizing a nonlinear objective function over a weighted independence system presented by a linear-optimization oracle. We provide a polynomial-time algorithm that determines an r-best solution for nonlinear functions of the total weight of an independent set, where r is a constant that depends on certain Frobenius numbers of the individual weights and is independent of the size of the ground set. In contrast, we show that finding an optimal (0-best) solution requires exponential time even in a very special case of the problem.

The convex hull $ψ_{n,n}$ of certain $(n!)^2$ tensors was considered recently in connection with graph isomorphism. We consider the convex hull $ψ_n$ of the $n!$ diagonals among these tensors. We show: 1. The polytope $ψ_n$ is a face of $ψ_{n,n}$. 2. Deciding if a graph $G$ has a subgraph isomorphic to $H$ reduces to optimization over $ψ_n$. 3. Optimization over $ψ_n$ reduces to optimization over $ψ_{n,n}$. In particular, this implies that the subgraph isomorphism problem reduces to optimization over $ψ_{n,n}$.