Using Learned Policies in Heuristic-Search Planning

Many current state-of-the-art planners rely on forward heuristic search. The success of such search typically depends on heuristic distance-to-the-goal estimates derived from the plangraph. Such estimates are effective in guiding search for many domains, but there remain many other domains where current heuristics are inadequate to guide forward search effectively. In some of these domains, it is possible to learn reactive policies from example plans that solve many problems. However, due to the inductive nature of these learning techniques, the policies are often faulty, and fail to achieve high success rates. In this work, we consider how to effectively integrate imperfect learned policies with imperfect heuristics in order to improve over each alone. We propose a simple approach that uses the policy to augment the states expanded during each search step. In particular, during each search node expansion, we add not only its neighbors, but all the nodes along the trajectory followed ...

• Type: Conference
• Year: 2007
• Where: IJCAI
• Authors: Sung Wook Yoon, Alan Fern, Robert Givan
• Keywords: Artificial Intelligence, Forward Heuristic Search, Heuristic, Heuristic Search, IJCAI 2007