Sciweavers

335 search results - page 5 / 67
» The Compositional Construction of Markov Processes
Sort
View
ICIP
2003
IEEE
14 years 9 months ago
Road network extraction in remote sensing by a Markov object process
In this paper, we rely on the theory of marked point processes to perform an unsupervised road network extraction from optical and radar images. A road network is modeled by a Mar...
Caroline Lacoste, Xavier Descombes, Josiane Zerubi...
TIT
2002
82views more  TIT 2002»
13 years 7 months ago
Order estimation for a special class of hidden Markov sources and binary renewal processes
We consider the estimation of the order, i.e., the number of hidden states, of a special class of discrete-time finite-alphabet hidden Markov sources. This class can be characteriz...
Sanjeev Khudanpur, Prakash Narayan
ICML
2006
IEEE
14 years 8 months ago
Fast direct policy evaluation using multiscale analysis of Markov diffusion processes
Policy evaluation is a critical step in the approximate solution of large Markov decision processes (MDPs), typically requiring O(|S|3 ) to directly solve the Bellman system of |S...
Mauro Maggioni, Sridhar Mahadevan
CALCO
2009
Springer
150views Mathematics» more  CALCO 2009»
14 years 2 months ago
Approximating Labelled Markov Processes Again!
Abstract. Labelled Markov processes are continuous-state fully probabilistic labelled transition systems. They can be seen as co-algebras of a suitable monad on the category of mea...
Philippe Chaput, Vincent Danos, Prakash Panangaden...
IWQOS
2011
Springer
12 years 10 months ago
An MDP-based admission control for a QoS-aware service-oriented system
In this paper, we address the problem of providing a service broker, which offers to prospective users a composite service with a range of different Quality of Service (QoS) class...
Marco Abundo, Valeria Cardellini, Francesco Lo Pre...