Simultaneous Localization and Recognition of Dynamic Hand Gestures

A method for the simultaneous localization and recognition of dynamic hand gestures is proposed. At the core of this method is a dynamic space-time warping (DSTW) algorithm, that aligns a pair of query and model gestures in both space and time. For every frame of the query sequence, feature detectors generate multiple hand region candidates. Dynamic programming is then used to compute both a global matching cost, which is used to recognize the query gesture, and a warping path, which aligns the query and model sequences in time, and also finds the best hand candidate region in every query frame. The proposed framework includes translation invariant recognition of gestures, a desirable property for many HCI systems. The performance of the approach is evaluated on a dataset of hand signed digits gestured by people wearing short sleeve shirts, in front of a background containing other non-hand skincolored objects. The algorithm simultaneously localizes the gesturing hand and recognizes ...

• Type: Conference
• Year: 2005
• Where: WACV
• Authors: Jonathan Alon, Vassilis Athitsos, Quan Yuan, Stan Sclaroff
• Keywords: Dynamic Hand Gestures, Dynamic Space-time Warping, Hand Candidate Region, WACV 2005