Sciweavers

774 search results - page 40 / 155
» Markov incremental constructions
Sort
View
JMLR
2010
82views more  JMLR 2010»
13 years 3 months ago
TIED: An Artificially Simulated Dataset with Multiple Markov Boundaries
We present an artificially simulated dataset (TIED) constructed so that there are many minimal sets of variables with maximal predictivity (i.e., Markov boundaries) and likewise m...
Alexander R. Statnikov, Constantin F. Aliferis
ICML
2006
IEEE
14 years 9 months ago
Fast direct policy evaluation using multiscale analysis of Markov diffusion processes
Policy evaluation is a critical step in the approximate solution of large Markov decision processes (MDPs), typically requiring O(|S|3 ) to directly solve the Bellman system of |S...
Mauro Maggioni, Sridhar Mahadevan
CALCO
2009
Springer
150views Mathematics» more  CALCO 2009»
14 years 3 months ago
Approximating Labelled Markov Processes Again!
Abstract. Labelled Markov processes are continuous-state fully probabilistic labelled transition systems. They can be seen as co-algebras of a suitable monad on the category of mea...
Philippe Chaput, Vincent Danos, Prakash Panangaden...
IPPS
1999
IEEE
14 years 1 months ago
A Parallel Phoneme Recognition Algorithm Based on Continuous Hidden Markov Model
This paper presents a parallel phoneme recognition algorithm based on the continuous Hidden Markov Model (HMM). The parallel phoneme recognition algorithm distributes 3-state HMMs...
Sang-Hwa Chung, Min-Uk Park, Hyung-Soon Kim
AAAI
2004
13 years 10 months ago
Bayesian Inference on Principal Component Analysis Using Reversible Jump Markov Chain Monte Carlo
Based on the probabilistic reformulation of principal component analysis (PCA), we consider the problem of determining the number of principal components as a model selection prob...
Zhihua Zhang, Kap Luk Chan, James T. Kwok, Dit-Yan...