How fast does the stationary distribution of the Markov chain modelling EAs concentrate on the homogeneous populations for small

One of the main difficulties faced when analyzing Markov chains modelling evolutionary algorithms is that their cardinality grows quite fast. A reasonable way to deal with this issue is to introduce an appropriate notion of a "coarse graining" or, in mathematical language, a quotient of such a Markov chain. The main topic of the current work is the construction of such a notion. We shell introduce a general construction of a quotient of an irreducible Markov chain with respect to an arbitrary equivalence relation on the state space. The stationary distribution of the quotient chain is "coherent" with the stationary distribution of the original chain. Although the transition probabilities of the quotient chain depend on the stationary distribution of the original chain, in some cases we can still exploit the quotient construction to deduce some properties of the stationary distribution of the original chain. As an example we shell establish some inequalities telling ...

• Type: Conference
• Year: 2006
• Where: DAGSTUHL
• Authors: Boris Mitavskiy, Jonathan E. Rowe
• Keywords: DAGSTUHL 2006, DAGSTUHL 2007, Markov Chains, Quotient, Stationary Distribution