Ultrasonic sensing for robust speech recognition

In this paper, we present our work using ultrasonic sensing of speech for digit recognition. First, a set of spectral ultrasonic features are developed and tuned in order to achieve optimal performance for the digit recognition task. Using these features, we demonstrate an overall accuracy of 33.00% on a digit recognition task using HMMs with recordings from 6 speakers. The results indicate that ultrasonic sensing of speech is viable, but that further work is needed to achieve word accuracies that match those of audio. Finally, experimental results are presented which demonstrate that fusing information from ultrasound and audio sources show marginal improvements over audio-only performances. This work may not be copied or reproduced in whole or in part for any commercial purpose. Permission to copy in whole or in part without payment of fee is granted for nonprofit educational and research purposes provided that all such whole or partial copies include the following: a notice that su...

• Type: Conference
• Year: 2010
• Where: ICASSP
• Authors: Sundararajan Srinivasan, Bhiksha Raj, Tony Ezzat
• Keywords: Digit Recognition, Digit Recognition Task, ICASSP 2010, Mitsubishi Electric Research, Signal Processing