Sciweavers

2415 search results - page 27 / 483
» Markov Processes on Curves
Sort
View
DMIN
2009
142views Data Mining» more  DMIN 2009»
13 years 5 months ago
Action Selection in Customer Value Optimization: An Approach Based on Covariate-Dependent Markov Decision Processes
Typical methods in CRM marketing include action selection on the basis of Markov Decision Processes with fixed transition probabilities on the one hand, and scoring customers separ...
Angi Roesch, Harald Schmidbauer
CORR
2006
Springer
86views Education» more  CORR 2006»
13 years 7 months ago
Optimal Distortion-Power Tradeoffs in Sensor Networks: Gauss-Markov Random Processes
We investigate the optimal performance of dense sensor networks by studying the joint source-channel coding problem. The overall goal of the sensor network is to take measurements ...
Nan Liu, Sennur Ulukus
DSN
2006
IEEE
14 years 1 months ago
Automatic Recovery Using Bounded Partially Observable Markov Decision Processes
This paper provides a technique, based on partially observable Markov decision processes (POMDPs), for building automatic recovery controllers to guide distributed system recovery...
Kaustubh R. Joshi, William H. Sanders, Matti A. Hi...
TIT
2002
82views more  TIT 2002»
13 years 7 months ago
Order estimation for a special class of hidden Markov sources and binary renewal processes
We consider the estimation of the order, i.e., the number of hidden states, of a special class of discrete-time finite-alphabet hidden Markov sources. This class can be characteriz...
Sanjeev Khudanpur, Prakash Narayan
CDC
2010
IEEE
145views Control Systems» more  CDC 2010»
13 years 2 months ago
Construction of Lyapunov functions for piecewise-deterministic Markov processes
The purpose of this contribution is twofold: 1) to present for the first time a Lyapunov function that proves exponential ergodicity of a process studied by the authors in [1], whe...
Alexandre R. Mesquita, João Pedro Hespanha