Trajectory-Based Representation of Human Actions

This work addresses the problem of human action recognition by introducing a representation of a human action as a collection of short trajectories that are extracted in areas of the scene with significant amount of visual activity. The trajectories are extracted by an auxiliary particle filtering tracking scheme that is initialized at points that are considered salient both in space and time. The spatiotemporal salient points are detected by measuring the variations in the information content of pixel neighborhoods in space and time. We implement an online background estimation algorithm in order to deal with inadequate localization of the salient points on the moving parts in the scene, and to improve the overall performance of the particle filter tracking scheme. We use a variant of the Longest Common Subsequence algorithm (LCSS) in order to compare different sets of trajectories corresponding to different actions. We use Relevance Vector Machines (RVM) in order to address the c...

• Type: Conference
• Year: 2007
• Where: AIHC
• Authors: Antonios Oikonomopoulos, Ioannis Patras, Maja Pantic, Nikos Paragios
• Keywords: AIHC 2007, Applied Computing, Salient Points, Short Trajectories, Spatiotemporal Salient Points