Nonparametric Model-Based Reinforcement Learning

This paper describes some of the interactions of model learning algorithms and planning algorithms we have found in exploring model-based reinforcement learning. The paper focuses on how local trajectory optimizers can be used e ectively with learned nonparametric models. We nd that trajectory planners that are fully consistent with the learned model often have di culty nding reasonable plans in the early stages of learning. Trajectory planners that balance obeying the learned model with minimizing cost (or maximizing reward) often do better, even if the plan is not fully consistent with the learned model.

• Type: Conference
• Year: 1997
• Where: NIPS
• Authors: Christopher G. Atkeson
• Keywords: Local Trajectory Optimizers, Model Learning Algorithms, NIPS 1997, NIPS 2007, Trajectory Planners