515 search results - page 5 / 103 » Approximating Markov Processes by Averaging |
AMAI
2004
Springer
14 years 24 days ago
2004
Springer
The majority of the work in the area of Markov decision processes has focused on expected values of rewards in the objective function and expected costs in the constraints. Althou...
LICS
2009
IEEE
14 years 2 months ago
2009
IEEE
—We associate a statistical vector to a trace and a geometrical embedding to a Markov Decision Process, based on a distance on words, and study basic Membership and Equivalence p...
ATAL
2009
Springer
14 years 1 months ago
2009
Springer
QEST
2010
IEEE
13 years 5 months ago
2010
IEEE
Abstract--Model checkers for concurrent probabilistic systems have become very popular within the last decade. The study of long-run average behavior has however received only scan...
ICML
2004
IEEE
14 years 8 months ago
2004
IEEE
A standard method for approximating averages in probabilistic models is to construct a Markov chain in the product space of the random variables with the desired equilibrium distr...