Sciweavers

27 search results - page 1 / 6
» Compositionality for Markov Reward Chains with Fast Transiti...
Sort
View
EPEW
2007
Springer
13 years 10 months ago
Compositionality for Markov Reward Chains with Fast Transitions
A parallel composition is defined for Markov reward chains with fast transitions and for discontinuous Markov reward chains. In this setting, compositionality with respect to the r...
Jasen Markovski, Ana Sokolova, Nikola Trcka, Erik ...
IPPS
2007
IEEE
14 years 1 months ago
A Markov Reward Model for Software Reliability
A compositional method for estimating software reliability of many threaded programs is developed. The method uses estimates of the reliability of individual modules and the proba...
YoungMin Kwon, Gul Agha
CORR
2010
Springer
175views Education» more  CORR 2010»
13 years 1 months ago
On the Combinatorial Multi-Armed Bandit Problem with Markovian Rewards
We consider a combinatorial generalization of the classical multi-armed bandit problem that is defined as follows. There is a given bipartite graph of M users and N M resources. F...
Yi Gai, Bhaskar Krishnamachari, Mingyan Liu
DAGSTUHL
2006
13 years 8 months ago
How fast does the stationary distribution of the Markov chain modelling EAs concentrate on the homogeneous populations for small
One of the main difficulties faced when analyzing Markov chains modelling evolutionary algorithms is that their cardinality grows quite fast. A reasonable way to deal with this iss...
Boris Mitavskiy, Jonathan E. Rowe
FMCO
2009
Springer
161views Formal Methods» more  FMCO 2009»
13 years 4 months ago
The How and Why of Interactive Markov Chains
This paper reviews the model of interactive Markov chains (IMCs, for short), an extension of labelled transition systems with exponentially delayed transitions. We show that IMCs a...
Holger Hermanns, Joost-Pieter Katoen