From bursty patterns to bursty facts: The effectiveness of temporal text mining for news

Many document collections are by nature dynamic, evolving as the topics or events they describe change. The goal of temporal text mining is to discover bursty patterns and to identify and highlight these changes to better enable readers to track stories. Here, we focus on the news domain, where the changes revolve around novel, previously unpublished, "facts" that have an effect on the story developments. However, despite intense research activities on bursty patterns, a lack of common procedures today makes it impossible to compare methods in a principled way. To close this gap, we (a) investigate how different temporal text mining methods discover novel facts and (b) present an evaluation framework for methods assessment, consisting of a set of procedures and metrics for cross-evaluating models. Bursty patterns are transformed into queries for sentence retrieval, either with or without taking into account internal pattern structure, and these sentences are compared with a s...

• Type: Journal
• Year: 2010
• Where: ECAI
• Authors: Ilija Subasic, Bettina Berendt
• Keywords: Artificial Intelligence, Bursty Patterns, ECAI 2010, Temporal Text, Temporal Text Mining