A Similarity Measure for Vision-Based Sign Recognition

When we encounter an English word that we do not understand, we can look it up in a dictionary. However, when an American Sign Language (ASL) user encounters an unknown sign, looking up the meaning of that sign is not a straightforward process. It has been recently proposed that this problem can be addressed using a computer vision system that helps users look up the meaning of a sign. In that approach, sign lookup can be treated as a video database retrieval problem. When the user encounters an unknown sign, the user provides a video example of that sign as a query, so as to retrieve the most similar signs in the database. A necessary component of such a sign lookup system is a similarity measure for comparing sign videos. Given a query video of a specific sign, the similarity measure should assign high similarity values to videos from the same sign, and low similarity values to videos from other signs. This paper evaluates a state-of-the-art video-based similarity measure called Dyna...

• Type: Journal
• Year: 2009
• Where: HCI
• Authors: Haijing Wang, Alexandra Stefan, Vassilis Athitsos
• Keywords: HCI 2009, Human Computer Interaction, Similarity Measure, Similarity Values, Unknown Sign