Sciweavers

CVPR
2012
IEEE

Enhanced continuous sign language recognition using PCA and neural network features

12 years 3 months ago
Enhanced continuous sign language recognition using PCA and neural network features
In this work a Gaussian Hidden Markov Model (GHMM) based automatic sign language recognition system is built on the SIGNUM database. The system is trained on appearance-based features as well as on features derived from a multilayer perceptron (MLP). Appearance-based features are directly extracted from the original images without any colored gloves or sensors. The posterior estimates are derived from a neural network. Whereas MLP based features are well-known in speech and optical character recognition, this is the first time that these features are used in a sign language system. The MLP based features improve the word error rate (WER) of the system from 16% to 13% compared to the appearance-based features. In order to benefit from the different feature types we investigate a combination technique. The models trained on each feature set are combined during the recognition step. By means of the combination technique, we could improve the word error rate of our best system by more t...
Yannick L. Gweth, Christian Plahl, Hermann Ney
Added 28 Sep 2012
Updated 28 Sep 2012
Type Journal
Year 2012
Where CVPR
Authors Yannick L. Gweth, Christian Plahl, Hermann Ney
Comments (0)