An Unsupervised Framework of Exploring Events on Twitter: Filtering, Extraction and Categorization

Twitter, as a popular microblogging service, has become a new information channel for users to receive and exchange the most up-to-date information on current events. However, since there is no control on how users can publish messages on Twitter, finding newsworthy events from Twitter becomes a difficult task like “finding a needle in a haystack”. In this paper we propose a general unsupervised framework to explore events from tweets, which consists of a pipeline process of filtering, extraction and categorization. To filter out noisy tweets, the filtering step exploits a lexicon-based approach to separate tweets that are event-related from those that are not. Then, based on these event-related tweets, the structured representations of events are extracted and categorized automatically using an unsupervised Bayesian model without the use of any labelled data. Moreover, the categorized events are assigned with the event type labels without human intervention. The proposed fr...

• Type: Journal
• Year: 2015
• Where: AAAI
• Authors: Deyu Zhou, Liangyu Chen, Yulan He
• Keywords: AAAI 2015, Intelligent Agents