Learning behavior styles with inverse reinforcement learning

We present a method for inferring the behavior styles of character controllers from a small set of examples. We show that a rich set of behavior variations can be captured by determining the appropriate reward function in the reinforcement learning framework, and show that the discovered reward function can be applied to different environments and scenarios. We also introduce a new algorithm to recover the unknown reward function that improves over the original apprenticeship learning algorithm. We show that the reward function representing a behavior style can be applied to a variety of different tasks, while still preserving the key features of the style present in the given examples. We describe an adaptive process where an author can, with just a few additional examples, refine the behavior so that it has better generalization properties. CR Categories: I.3.7 [Computer Graphics]: Three-Dimensional Graphics and Realism—Animation;

• Type: Conference
• Year: 2010
• Where: SIGGRAPH
• Authors: Seong Jae Lee, Zoran Popovic
• Keywords: Appropriate Reward Function, Behavior Style, Computer Graphics, Reward Function, SIGGRAPH 2010