Predicting Automatic Speech Recognition Performance Using Prosodic Cues

In spoken dialogue systems, it is important for a system to know how likely a speech recognition hypothesis is to be correct, so it can reprompt for fresh input, or, in cases where many errors have occurred, change its interaction strategy or switch the caller to a human attendant. We have discovered prosodic features which more accurately predict when a recognition hypothesis contains a word error than the acoustic con dence score thresholds traditionally used in automatic speech recognition. We present analytic results indicating that there are signi cant prosodic di erences between correctly and incorrectly recognized turns in the toot train information corpus. We then present machine learning results showing how the use of prosodic features to automatically predict correct versus incorrectly recognized turns improves over the use of acoustic con dence scores alone.

• Type: Conference
• Year: 2000
• Where: ANLP
• Authors: Diane J. Litman, Julia Hirschberg, Marc Swerts
• Keywords: ANLP 2000, Prosodic Features, Recognition Hypothesis, Speech Recognition Hypothesis