Processing online news streams for large-scale semantic analysis

— While Internet has enabled us to access a vast amount of online news articles originating from thousands of different sources, the human capability to read all these articles has stayed rather constant. Usually, the publishing industry takes over the role of filtering this enormous amount of information and presenting it in an appropriate way to the group of their subscribers. In this paper, the semantic analysis of such news streams is discussed by introducing a system that streams online news collected by the Europe Media Monitor to our proposed semantic news analysis system. Thereby, we describe in detail the emerging challenges and the corresponding engineering solutions to process incoming articles close to real-time. To demonstrate the use of our system, the case studies show a) temporal analysis of entities, such as institutions or persons, and b) their co-occurence in news articles.

• Type: Conference
• Year: 2010
• Where: ICDE
• Authors: Milos Krstajic, Florian Mansmann, Andreas Stoffel, Martin Atkinson, Daniel A. Keim
• Keywords: Corresponding Engineering Solutions, Database, Europe Media Monitor, ICDE 2010, Semantic Analysis