Confidence-based policy learning from demonstration using Gaussian mixture models

We contribute an approach for interactive policy learning through expert demonstration that allows an agent to actively request and effectively represent demonstration examples. In order to address the inherent uncertainty of human demonstration, we represent the policy as a set of Gaussian mixture models (GMMs), where each model, with multiple Gaussian components, corresponds to a single action. Incrementally received demonstration examples are used as training data for the GMM set. We then introduce our confident execution approach, which focuses learning on relevant parts of the domain by enabling the agent to identify the need for and request demonstrations for specific parts of the state space. The agent selects between demonstration and autonomous execution based on statistical analysis of the uncertainty of the learned Gaussian mixture set. As it achieves proficiency at its task and gains confidence in its actions, the agent operates with increasing autonomy, eliminating the ne...

• Type: Conference
• Year: 2007
• Where: ATAL
• Authors: Sonia Chernova, Manuela M. Veloso
• Keywords: ATAL 2007, Demonstration Examples, Gaussian Mixture, Gaussian Mixture Models, Intelligent Agents