2005 search results - page 3 / 401 » Decisive Markov Chains |
CDC
2008
IEEE
14 years 1 months ago
2008
IEEE
— Many decision systems rely on a precisely known Markov Chain model to guarantee optimal performance, and this paper considers the online estimation of unknown, nonstationary Ma...
JMLR
2006
2006
Geometric Variance Reduction in Markov Chains: Application to Value Function and Gradient Estimation
13 years 7 months ago
We study a sequential variance reduction technique for Monte Carlo estimation of functionals in Markov Chains. The method is based on designing sequential control variates using s...
MMB
2010
Springer
13 years 9 months ago
2010
Springer
Abstract. Bisimulation reduction is a classical means to fight the infamous state space explosion problem, which limits the applicability of automated methods for verification li...
CONCUR
1999
Springer
13 years 11 months ago
1999
Springer
d abstract) Christel Baiera, Joost-Pieter Katoenb;c and Holger Hermannsc aLehrstuhl fur Praktische Informatik II, University of Mannheim 68131 Mannheim, Germany bLehrstuhl fur Info...
ANSS
2004
IEEE
13 years 11 months ago
2004
IEEE
The Random Early Detection (RED) scheme for congestion control in TCP is well known over a decade. Due to a number of control parameters in RED, it cannot make acceptable packet-d...