Tagging Sentence Boundaries

In this paper we tackle sentence boundary disambiguation through a part-of-speech (POS) tagging framework. We describe necessary changes in text tokenization and the implementation of a POS tagger and provide results of an evaluation of this system on two corpora. We also describe an extension of the traditional POS tagging by combining it with the document-centered approach to proper name identification and abbreviation handling. This made the resulting system robust to domain and topic shifts.

• Type: Conference
• Year: 2000
• Where: ANLP
• Authors: Andrei Mikheev
• Keywords: ANLP 2000, POS Tagger, Sentence Boundary Disambiguation, Text Tokenization