Context-based Word Acquisition for Situated Dialogue in a Virtual World

To tackle the vocabulary problem in conversational systems, previous work has applied unsupervised learning approaches on co-occurring speech and eye gaze during interaction to automatically acquire new words. Although these approaches have shown promise, several issues related to human language behavior and human-machine conversation have not been addressed. First, psycholinguistic studies have shown certain temporal regularities between human eye movement and language production. While these regularities can potentially guide the acquisition process, they have not been incorporated in the previous unsupervised approaches. Second, conversational systems generally have an existing knowledge base about the domain and vocabulary. While the existing knowledge can potentially help bootstrap and constrain the acquired new words, it has not been incorporated in the previous models. Third, eye gaze could serve different functions in human-machine conversation. Some gaze streams may not be c...

• Type: Journal
• Year: 2010
• Where: JAIR
• Authors: Shaolin Qu, Joyce Yue Chai
• Keywords: Eye Gaze, Human-machine Conversation, JAIR 2010, Word Acquisition