Some Experiments in Audio-Visual Speech Processing

Abstract. Natural speech is produced by the vocal organs of a particular talker. The acoustic features of the speech signal must therefore be correlated with the movements of the articulators (lips, jaw, tongue, velum,...). For instance, hearing impaired people (and not only them) improve their understanding of speech by lip reading. This chapter is an overview of audiovisual speech processing with emphasis on some experiments concerning recognition, speaker verification, indexing and corpus based synthesis from tongue and lips movements.

• Type: Conference
• Year: 2007
• Where: NOLISP
• Authors: Gérard Chollet, R. Landais, Thomas Hueber, Hervé Bredin, Chafic Mokbel, Patrick Perrot, Leila Zouari
• Keywords: Audiovisual Speech Processing, Natural Speech, NOLISP 2007, Signal Processing, Speech Signal