Comparison of HMM and TMDN methods for lip synchronisation

This paper presents a comparison between a hidden Markov model (HMM) based method and a novel artificial neural network (ANN) based method for lip synchronisation. Both model types were trained on motion tracking data and a perceptual evaluation was carried out comparing the output of the models, both to each other and to the original tracked data. It was found that the ANN based method was judged significantly better than the HMM based method. Furthermore the original data was not judged significantly better than the output of the ANN method.

• Type: Journal
• Year: 2010
• Where: INTERSPEECH
• Authors: Gregor Hofer, Korin Richmond
• Keywords: Artificial Neural Network, Hidden Markov Model, HMM Based Method, INTERSPEECH 2010, Signal Processing