Adapting acoustic and lexical models to dysarthric speech

Dysarthria is a motor speech disorder resulting from neurological damage to the part of the brain that controls the physical production of speech and is, in part, characterized by pronunciation errors that include deletions, substitutions, insertions, and distortions of phonemes. These errors follow consistent intra-speaker patterns that we exploit through acoustic and lexical model adaptation to improve automatic speech recognition (ASR) on dysarthric speech. We show that acoustic model adaptation yields an average relative word error rate (WER) reduction of 36.99% and that pronunciation lexicon adaptation (PLA) further reduces the WER by an average of 8.29% relative on a large vocabulary task of over 1500 words for 6 speakers with severe to moderate dysarthria. PLA also shows an average relative WER reduction of 7.11% on speaker-dependent models evaluated using 5-fold crossvalidation.

• Type: Journal
• Year: 2011
• Where: ICASSP
• Authors: Kinfe Tadesse Mengistu, Frank Rudzicz
• Keywords: Average Relative Word, ICASSP 2011, Model Adaptation, Motor Speech Disorder, Signal Processing