515 search results - page 9 / 103 » Approximating Markov Processes by Averaging |
ICPR
2008
IEEE
14 years 8 months ago
2008
IEEE
In this work we present a model that uses a Dirichlet Process (DP) with a dynamic spatial constraints to approximate a non-homogeneous hidden Markov model (NHMM). The coefficient ...
ICASSP
2008
IEEE
14 years 1 months ago
2008
IEEE
In this paper we propose novel algorithms for image restoration and parameter estimation with a Generalized Gaussian Markov Random Field prior utilizing variational distribution a...
WSC
2008
13 years 9 months ago
2008
Reinforcement Learning (RL) is a simulation-based technique useful in solving Markov decision processes if their transition probabilities are not easily obtainable or if the probl...
ICASSP
2008
IEEE
14 years 1 months ago
2008
IEEE
— The paper studies distributed average consensus in sensor networks, when the sensors exchange quantized data at each time step. We show that randomizing the exchanged sensor da...
CORR
2010
Springer
13 years 7 months ago
2010
Springer
We study the convergence of Markov Decision Processes made of a large number of objects to optimization problems on ordinary differential equations (ODE). We show that the optimal...