arXiv++ Combinatorics

A transitive simple subgroup of a finite symmetric group is very rarely contained in a full wreath product in product action. All such simple permutation groups are determined in this paper. This remarkable conclusion is reached after a definition and detailed examination of `Cartesian decompositions' of the permuted set, relating them to certain `Cartesian systemsof subgroups'. These concepts, and the bijective connections between them, are explored in greater generality, with specific future applications in mind.

We explicitly determine all of the transitive groups of degree p-squared, p a prime, whose Sylow p-subgroup is not the wreath product of two cyclic groups of order p. Furthermore, we provide a general description of the transitive groups of degree p-squared whose Sylow p-subgroup is such a wreath product, and explicitly determine most of them. As applications, we solve the Cayley Isomorphism problem for Cayley objects of an abelian group of order p-squared, explicitly determine the full automorphism group of Cayley graphs of abelian groups of order p-squared, and find all nonnormal Cayley graphs of order p-squared.

A new extension of the major index, defined in terms of Coxeter elements, is introduced. For the classical Weyl groups of type $B$, it is equidistributed with length. For more general wreath products it appears in an explicit formula for the Hilbert series of the (diagonal action) invariant algebra.