Web image prediction using multivariate point processes

In this paper, we investigate a problem of predicting what images are likely to appear on the Web at a future time point, given a query word and a database of historical image streams that potentiates learning of uploading patterns of previous user images and associated metadata. We address such a Web photo prediction problem at both a collective group level and an individual user level. We develop a predictive framework based on the multivariate point process, which employs a stochastic parametric model to solve the relations between image occurrence and the covariates that influence it, in a globally optimal, flexible, and scalable way. Using Flickr datasets of more than ten million images of 40 topics, our empirical results show that the proposed algorithm is more successful in predicting unseen Web images than other candidate methods, including reasoning on semantic meanings only, a state-of-art image retrieval method, and a generative topic model. Categories and Subject Descrip...

• Type: Journal
• Year: 2012
• Where: KDD
• Authors: Gunhee Kim, Fei-Fei Li, Eric P. Xing
• Keywords: Data Mining, Image Streams, Information Storage And Retrieval, KDD 2012, Unseen Web