Japanese Phone Recognition Using Lip Image Information

This paper describes Japanese phone recognition for lip reading based on a novel feature called trajectory feature to obtain high recognition rate. Trajectory feature is a time change of two mouth shape features expressed as a two-dimensional trajectory of the lip motion. The most similar trajectory in a database which is compared with the target trajectory by DP matching is selected as a result phone. Traditional researches concerned phone recognition experimented with only Japanese five vowels. In this paper, experiments were conducted for Japanese 45 phones with five person, and classified into five vowels and ten consonants, and recognition rate of 94.1% and 28.9%, respectively, were obtained.

• Type: Conference
• Year: 2007
• Where: MVA
• Authors: Takeshi Saitoh, Mitsugu Hisagi, Ryosuke Konishi
• Keywords: Computer Vision, Feature Called Trajectory, MVA 2007, Trajectory, Trajectory Feature