markov process
48 papers tagged with this keyword
Random Walks on Strict Partitions
Published in Journal of Mathematical Sciences, vol. 168, no. 3, pp. 437-463, 2010
• View Publication
• BIB
We consider a certain sequence of random walks. The state space of the n-th random walk is the set of all strict partitions of n (that is, partitions without equal parts).
We prove that, as n goes to infinity, these random walks converge to a continuous-time Markov process. The state space of this process is the infinite-dimensional simplex consisting of all nonincreasing infinite sequences of nonnegative numbers with sum less than or equal to one. The main result about the limit process is the expression of its the pre-generator as a formal second order differential operator in a polynomial algebra.
Of separate interest is the generalization of Kerov interlacing coordinates to the case of shifted Young diagrams.
Anisotropic Young diagrams and infinite-dimensional diffusion processes with the Jack parameter
Published in International Mathematics Research Notices 2010 (2010), no.6, 1102-1166
• View Publication
• BIB
We construct a family of Markov processes with continuous sample trajectories on an infinite-dimensional space, the Thoma simplex. The family depends on three continuous parameters, one of which, the Jack parameter, is similar to the beta parameter in random matrix theory. The processes arise in a scaling limit transition from certain finite Markov chains, the so called up-down chains on the Young graph with the Jack edge multiplicities. Each of the limit Markov processes is ergodic and its stationary distribution is a symmetrizing measure. The infinitesimal generators of the processes are explicitly computed; viewed as selfadjoint operators in the L^2 spaces over the symmetrizing measures, the generators have purely discrete spectrum which is explicitly described.
For the special value 1 of the Jack parameter, the limit Markov processes coincide with those of the recent work by Borodin and the author (Prob. Theory Rel. Fields 144 (2009), 281--318; arXiv:0706.1034). In the limit as the Jack parameter goes to 0, our family of processes degenerates to the one-parameter family of diffusions on the Kingman simplex studied long ago by Ethier and Kurtz in connection with some models of population genetics.
The techniques of the paper are essentially algebraic. The main computations are performed in the algebra of shifted symmetric functions with the Jack parameter and rely on the concept of anisotropic Young diagrams due to Kerov.
Asymptotic evolution of acyclic random mappings
Published
• View Publication
• BIB
An acyclic mapping from an $n$ element set into itself is a mapping $φ$ such that if $φ^k(x) = x$ for some $k$ and $x$, then $φ(x) = x$. Equivalently, $φ^\ell = φ^{\ell+1} = ...$ for $\ell$ sufficiently large. We investigate the behavior as $n \to \infty$ of a Markov chain on the collection of such mappings. At each step of the chain, a point in the $n$ element set is chosen uniformly at random and the current mapping is modified by replacing the current image of that point by a new one chosen independently and uniformly at random, conditional on the resulting mapping being again acyclic. We can represent an acyclic mapping as a directed graph (such a graph will be a collection of rooted trees) and think of these directed graphs as metric spaces with some extra structure. Heuristic calculations indicate that the metric space valued process associated with the Markov chain should, after an appropriate time and ``space'' rescaling, converge as $n \to \infty$ to a real tree ($\R$-tree) valued Markov process that is reversible with respect to a measure induced naturally by the standard reflected Brownian bridge. The limit process, which we construct using Dirichlet form methods, is a Hunt process with respect to a suitable Gromov-Hausdorff-like metric. This process is similar to one that appears in earlier work by Evans and Winter as the limit of chains involving the subtree prune and regraft tree (SPR) rearrangements from phylogenetics.
Continuous Time Markov Processes on Graphs
Published
• View Publication
• BIB
We study continuous time Markov processes on graphs. The notion of frequency is introduced, which serves well as a scaling factor between any Markov time of a continuous time Markov process and that of its jump chain. As an application, we study ``multi-person simple random walks'' on a graph G with n vertices. There are n persons distributed randomly at the vertices of G. In each step of this discrete time Markov process, we randomly pick up a person and move it to a random adjacent vertex. We give estimate on the expected number of steps for these $n$ persons to meet all together at a specific vertex, given that they are at different vertices at the begininng. For regular graphs, our estimate is exact.
Juggling probabilities
Published
• View Publication
• BIB
The act of a person juggling can be viewed as a Markov process if we assume that the juggler throws to random heights. I make this association for the simplest reasonable model of random juggling and compute the steady state probabilities in terms of the Stirling numbers of the second kind. I also explore several alternate models of juggling.
Linearization coefficients for orthogonal polynomials using stochastic processes
Published in Annals of Probability 2005, Vol. 33, No. 1, 114-136
• View Publication
• BIB
Given a basis for a polynomial ring, the coefficients in the expansion of a product of some of its elements in terms of this basis are called linearization coefficients. These coefficients have combinatorial significance for many classical families of orthogonal polynomials. Starting with a stochastic process and using the stochastic measures machinery introduced by Rota and Wallstrom, we calculate and give an interpretation of linearization coefficients for a number of polynomial families. The processes involved may have independent, freely independent or q-independent increments. The use of noncommutative stochastic processes extends the range of applications significantly, allowing us to treat Hermite, Charlier, Chebyshev, free Charlier and Rogers and continuous big q-Hermite polynomials. We also show that the q-Poisson process is a Markov process.
Fluid Limits of Pure Jump Markov Processes: a Practical Guide
A rescaled Markov chain converges uniformly in probability to the solution of an ordinary differential equation, under carefully specified assumptions.
The presentation is much simpler than those in the outside literature.
The result may be used to build parsimonious models of large random or pseudo-random systems.
Structure of large random hypergraphs
Published
• View Publication
• BIB
The theme of this paper is the derivation of analytic formulae for certain large combinatorial structures. The formulae are obtained via fluid limits of pure jump type Markov processes, established under simple conditions on the Laplace transforms of their Levy kernels. Furthermore, a related Gaussian approximation allows us to describe the randomness which may persist in the limit when certain parameters take critical values. Our method is quite general, but is applied here to vertex identifiability in random hypergraphs. A vertex v is identifiable in n steps if there is a hyperedge containing v all of whose other vertices are identifiable in fewer than n steps. We say that a hyperedge is identifiable if every one of its vertices is identifiable. Our analytic formulae describe the asymptotics of the number of identifiable vertices and the number of identifiable hyperedges for a Poisson random hypergraph on a set of N vertices, in the limit as N goes to infinity.