Sciweavers

FLAIRS
2010

Learning to Identify and Track Imaginary Objects Implied by Gestures

14 years 1 months ago
Learning to Identify and Track Imaginary Objects Implied by Gestures
A vision-based machine learner is presented that learns characteristic hand and object movement patterns for using certain objects, and uses this information to recreate the "imagined" object when the gesture is performed without the object. To classify the gestures/objects, Hidden Markov Models (HMMs) are trained on the moment-to-moment velocity and shape of the object-manipulating hand. Object identification using the Forward-Backward algorithm achieved 89% identification accuracy when deciding between 6 objects. Two methods for rotating and positioning imaginary objects in the frame were compared. One used a modified HMM to smooth the observed rotation of the hand, with mixtures of Von Mises distributions. The other used least squares regression to determine the object rotation as a function of hand location, and provided more accurate rotational positioning. The method was adapted to real-time classification from a low-fps webcam stream and still succeeds when the testin...
Andreya Piplica, Alexandra Olivier, Allison Petros
Added 02 Oct 2010
Updated 02 Oct 2010
Type Conference
Year 2010
Where FLAIRS
Authors Andreya Piplica, Alexandra Olivier, Allison Petrosino, Kevin Gold
Comments (0)