Visual Sign Language Recognition Based on HMMs and Auto-regressive HMMs

Abstract. A sign language recognition system based on Hidden Markov Models(HMMs) and Auto-regressive Hidden Markov Models(ARHMMs) has been proposed in this paper. ARHMMs fully consider the observation relationship and are helpful to discriminate signs which don’t have obvious state transitions while similar in motion trajectory. ARHMM which models the observation by mixture conditional linear Gaussian is proposed for sign language recognition. The corresponding training and recognition algorithms for ARHMM are also developed. A hybrid structure to combine ARHMMs with HMMs based on the trick of using an ambiguous word set is presented and the advantages of both models are revealed in such a frame work.

• Type: Conference
• Year: 2005
• Where: GW
• Authors: Xiaolin Yang, Feng Jiang, Han Liu, Hongxun Yao, Wen Gao, Chunli Wang
• Keywords: Auto-regressive Hidden Markov, GW 2005, Hidden Markov, Sign Language Recognition