Text Segmentation with Multiple Surface Linguistic Cues

In general, a certain range of sentences in a text, is widely assumed to form a coherent unit which is called a discourse segment. Identifying the segment boundaries is a first step to recognize the structure of a text. In this paper, we describe a method for identifying segment boundaries of a Japanese text with the aid of multiple surface linguistic cues, though our experiments might be small-scale. We also present a method of training the weights for multiple linguistic cues automatically without the overfitting problem.

• Type: Conference
• Year: 1998
• Where: ACL
• Authors: Hajime Mochizuki, Takeo Honda, Manabu Okumura
• Keywords: ACL 1998, ACL 2007, Discourse Segment, Linguistic Cues, Segment Boundaries