Learning 3D Action Models from a few 2D videos for View Invariant Action Recognition

Most existing approaches for learning action models work by extracting suitable low-level features and then training appropriate classifiers. Such approaches require large amounts of training data and do not generalize well to variations in viewpoint, scale and across datasets. Some work has been done recently to learn multi-view action models from Mocap data, but obtaining such data is time consuming and requires costly infrastructure. We present a method that addresses both these issues by learning action models from just a few video training samples. We model each action as a sequence of primitive actions, represented as functions which transform the actor’s state. We formulate model learning as a curve-fitting problem, and present a novel algorithm for learning human actions by lifting 2D annotations of a few keyposes to 3D and interpolating between them. Actions are inferred by sampling the models and accumulating the feature weights learned discriminatively using a latent st...

• Type: Conference
• Year: 2010
• Where: CVPR
• Authors: Pradeep Natarajan, Vivek Singh, Ram Nevatia
• Keywords: Action Models, Computer Vision, CVPR 2010, Most Existing Approaches, Multi-view Action Models