Classifying Visemes for Automatic Lipreading

Automatic lipreading is automatic speech recognition that uses only visual information. The relevant data in a video signal is isolated and features are extracted from it. From a sequence of feature vectors, where every vector represents one video image, a sequence of higher level semantic elements is formed. These semantic elements are “visemes” the visual equivalent of “phonemes” The developed prototype uses a Time Delayed Neural Network to classify the visemes.

• Type: Conference
• Year: 1999
• Where: TSD
• Authors: Michiel Visser, Mannes Poel, Anton Nijholt
• Keywords: Automatic Speech Recognition, Level Semantic Elements, Semantic Elements, Signal Processing, TSD 1999