Mining User Interests from Personal Photos

Personal photos are enjoying explosive growth with the popularity of photo-taking devices and social media. The vast amount of online photos largely exhibit users’ interests, emotion and opinions. Mining user interests from personal photos can boost a number of utilities, such as advertising, interest based community detection and photo recommendation. In this paper, we study the problem of user interests mining from personal photos. We propose a User Image Latent Space Model to jointly model user interests and image contents. User interests are modeled as latent factors and each user is assumed to have a distribution over them. By inferring the latent factors and users’ distributions, we can discover what the users are interested in. We model image contents with a four-level hierarchical structure where the layers correspond to themes, semantic regions, visual words and pixels respectively. Users’ latent interests are embedded in the theme layer. Given image contents, users’ ...

• Type: Journal
• Year: 2015
• Where: AAAI
• Authors: Pengtao Xie, Yulong Pei, Yuan Xie, Eric P. Xing
• Keywords: AAAI 2015, Intelligent Agents