A Phoneme Probability Display for Individuals with Hearing Disabilities

We are building an aid for individuals with hearing impairments which converts continuous speech into an animated visual display. A speech analysis system continuously estimates phoneme probabilities from the input acoustic stream. Phoneme symbols are displayed graphically with brightness in proportion to estimated phoneme probabilities. We use an automated layout algorithm to design the display to group acoustically confusable phonemes together in the graphical display.

• Type: Conference
• Year: 1998
• Where: ASSETS
• Authors: Deb Roy, Alex Pentland
• Keywords: ASSETS 1998, Emerging Technology, Input Acoustic Stream, Phoneme Probabilities, Phoneme Symbols