Sciweavers

COLING
1992
14 years 1 days ago
Tokenization As The Initial Phase In NLP
In this paper, the authors address the significance and complexityof tokenization, the beginning step of NLP. Notions of word and token are discussed and defined from the viewpoin...
Jonathan J. Webster, Chunyu Kit