Sciweavers

774 search results - page 41 / 155
» Markov incremental constructions
Sort
View
ISMB
1993
13 years 10 months ago
Using Dirichlet Mixture Priors to Derive Hidden Markov Models for Protein Families
A Bayesian method for estimating the amino acid distributions in the states of a hidden Markov model (HMM) for a protein familyor the columns of a multiple alignment of that famil...
Michael Brown, Richard Hughey, Anders Krogh, I. Sa...
AUTOMATICA
2005
117views more  AUTOMATICA 2005»
13 years 9 months ago
Dwell-time controllers for stochastic systems with switching Markov chain
We study the problem of feedback stabilization of a family of nonlinear stochastic systems with switching mechanism modeled by a Markov chain. We introduce a novel notion of stabi...
Stefano Battilotti, A. De Santis
TIT
2002
82views more  TIT 2002»
13 years 8 months ago
Order estimation for a special class of hidden Markov sources and binary renewal processes
We consider the estimation of the order, i.e., the number of hidden states, of a special class of discrete-time finite-alphabet hidden Markov sources. This class can be characteriz...
Sanjeev Khudanpur, Prakash Narayan
TCBB
2011
13 years 4 months ago
Semi-Markov Models for Brownian Dynamics Permeation in Biological Ion Channels
—Constructing accurate computational models that explain how ions permeate through a biological ion channel is an important problem in biophysics and drug design. Brownian dynami...
Vikram Krishnamurthy, Kai Yiu Luk
ICML
2002
IEEE
14 years 9 months ago
Discovering Hierarchy in Reinforcement Learning with HEXQ
An open problem in reinforcement learning is discovering hierarchical structure. HEXQ, an algorithm which automatically attempts to decompose and solve a model-free factored MDP h...
Bernhard Hengst