829 search results - page 6 / 166 » A time aggregation approach to Markov decision processes |
LICS
2009
IEEE
14 years 5 months ago
2009
IEEE
—We associate a statistical vector to a trace and a geometrical embedding to a Markov Decision Process, based on a distance on words, and study basic Membership and Equivalence p...
CORR
2010
Springer
13 years 11 months ago
2010
Springer
We establish the existence of optimal scheduling strategies for time-bounded reachability in continuous-time Markov decision processes, and of co-optimal strategies for continuous-...
SIGMETRICS
2000
ACM
14 years 3 months ago
2000
ACM
We present a new approximation algorithm based on an exact representation of the state space S, using decision diagrams, and of the transition rate matrix R, using Kronecker algeb...
SIGMETRICS
2002
ACM
13 years 10 months ago
2002
ACM
We introduce a new methodology for the exact analysis of M/G/1-type Markov processes. The methodology uses basic, well-known results for Markov chains by exploiting the structure ...
DATE
2010
IEEE
14 years 4 months ago
2010
IEEE
Abstract—Cyber Physical Systems are distributed systemsof-systems that integrate sensing, processing, networking and actuation. Aggregating physical data over space and in time e...