Planning and Acting in Uncertain Environments using Probabilistic Inference

— An important problem in robotics is planning and selecting actions for goal-directed behavior in noisy uncertain environments. The problem is typically addressed within the framework of partially observable Markov decision processes (POMDPs). Although efficient algorithms exist for learning policies for MDPs, these algorithms do not generalize easily to POMDPs. In this paper, we propose a framework for planning and action selection based on probabilistic inference in graphical models. Unlike previous approaches based on MAP inference, our approach utilizes the most probable explanation (MPE) of variables in a graphical model, allowing tractable and efficient inference of actions. It generalizes easily to complex partially observable environments. Furthermore, it allows rewards and costs to be incorporated in a straightforward manner as part of the inference process. We investigate the application of our approach to the problem of robot navigation by testing it on a suite of well-...

• Type: Conference
• Year: 2006
• Where: IROS
• Authors: Deepak Verma, Rajesh P. N. Rao
• Keywords: Graphical Model, IROS 2006, Noisy Uncertain Environments, Observable Markov Decision, Robotics