Categorizing Unknown Words: Using Decision Trees to Identify Names and Misspellings

This paper introduces a system for categorizing unknown words. The system is based on a multicomponent architecture where each component is responsible for identifying one class of unknown words. The focus of this paper is the components that identify names and spelling errors. Each component uses a decision tree architecture to combine multiple types of evidence about the unknown word. The system is evaluated using data from live closed captions - a genre replete with a wide variety of unknown words.

• Type: Conference
• Year: 2000
• Where: ANLP
• Authors: Janine Toole
• Keywords: ANLP 2000, Decision Tree Architecture, Multicomponent Architecture, Unknown Words