Sequential Belief-Based Fusion of Manual and Non-manual Information for Recognizing Isolated Signs

Abstract. This work aims to recognize signs which have both manual and nonmanual components by providing a sequential belief-based fusion mechanism. We propose a methodology based on belief functions for fusing extracted manual and non-manual features in a sequential two-step approach. The belief functions based on the likelihoods of the hidden Markov models are used to decide whether there is an uncertainty in the decision of the first step and also to identify the uncertainty clusters. Then we proceed to the second step which utilizes only the non-manual features within the identified cluster, only if there is an uncertainty. Keywords. Sign language recognition, hand gestures, head gestures, nonmanual signals, hidden Markov models, belief functions

• Type: Conference
• Year: 2007
• Where: GW
• Authors: Oya Aran, Thomas Burger, Alice Caplier, Lale Akarun
• Keywords: Belief Functions, Biometrics, GW 2007, Hidden Markov Models, Sequential Belief-based Fusion