arXiv++ Combinatorics

The present paper is a detailed version of math/0003031. We introduce and study a new basis in the algebra of symmetric functions. The elements of this basis are called the Frobenius-Schur functions (FS-functions, for short). Our main motivation for studying the FS-functions is the fact that they enter a formula expressing the combinatorial dimension of a skew Young diagram in terms of the Frobenius coordinates. This formula plays a key role in the asymptotic character theory of the symmetric groups. The FS-functions are inhomogeneous, and their top homogeneous components coincide with the conventional Schur functions. The FS-functions are best described in the super realization of the algebra of symmetric functions. As supersymmetric functions, the FS-functions can be characterized as a solution to an interpolation problem. Our main result is a simple determinantal formula for the transition coefficients between the FS-functions and the Schur functions. We also establish the FS analogs for a number of basic facts concerning the Schur functions: Jacobi-Trudi formula together with its dual form; combinatorial formula (expression in terms of tableaux); Giambelli formula and the Sergeev-Pragacz formula. All these results hold for a large family of bases interpolating between the FS-functions and the ordinary Schur functions.

Versions of Bailey's lemma which change the base from q to q^2 or q^3 are given. Iterates of these versions give many new versions of multisum Rogers-Ramanujan identities. We also prove Melzer's conjectures for the Fermionic forms of the supersymmetric analogues of Virasoro characters.

We produce a new basis for the Schur and Weyl modules associated to a row-convex shape, D. The basis is indexed by new class of "straight" tableaux which we introduce by weakening the usual requirements for standard tableaux. Spanning is proved via a new straightening algorithm for expanding elements of the representation into this basis. For skew shapes, this algorithm specializes to the classical straightening law. The new straight basis is used to produce bases for flagged Schur and Weyl modules, to provide Groebner and sagbi bases for the homogeneous coordinate rings of some configuration varieties and to produce a flagged branching rule for row-convex representations. Systematic use of supersymmetric letterplace techniques enables the representation theoretic results to be applied to representations of the general linear Lie superalgebra as well as to the general linear group.