Sciweavers

270 search results - page 12 / 54
» Estimation of non-stationary Markov Chain transition models
Sort
View
JMLR
2010
125views more  JMLR 2010»
13 years 2 months ago
Variational methods for Reinforcement Learning
We consider reinforcement learning as solving a Markov decision process with unknown transition distribution. Based on interaction with the environment, an estimate of the transit...
Thomas Furmston, David Barber
ICDIM
2007
IEEE
13 years 9 months ago
Predicting durability in DHTs using Markov chains
We consider the problem of data durability in lowbandwidth large-scale distributed storage systems. Given the limited bandwidth between replicas, these systems suffer from long re...
Fabio Picconi, Bruno Baynat, Pierre Sens
IROS
2008
IEEE
142views Robotics» more  IROS 2008»
14 years 1 months ago
Probabilistic mapping of dynamic obstacles using Markov chains for replanning in dynamic environments
— Robots acting in populated environments must be capable of safe but also time efficient navigation. Trying to completely avoid regions resulting from worst case predictions of...
Florian Rohrmüller, Matthias Althoff, Dirk Wo...
TGC
2010
Springer
13 years 5 months ago
A Tool for Checking Probabilistic Properties of COWS Services
Abstract. We present a tool developed for fostering probabilistic model checking of services formally specified in Scows, a stochastic enrichment of the Calculus for Orchestration ...
Igor Cappello, Paola Quaglia
ACMSE
1992
ACM
13 years 11 months ago
Disk performance enhancement through Markov-based cylinder remapping
A scheme for disk subsystem performance enhancement that is based on (virtual) cylinder remapping is proposed. A natural workload on a real system is measured, and statistical tes...
Robert Geist, Darrell Suggs, Robert G. Reynolds, S...