TagSense: a smartphone-based approach to automatic image tagging

Mobile phones are becoming the convergent platform for personal sensing, computing, and communication. This paper attempts to exploit this convergence towards the problem of automatic image tagging. We envision TagSense, a mobile phone based collaborative system that senses the people, activity, and context in a picture, and merges them carefully to create tags on-the-fly. The main challenge pertains to discriminating phone users that are in the picture from those that are not. We deploy a prototype of TagSense on 8 Android phones, and demonstrate its effectiveness through 200 pictures, taken in various social settings. While research in face recognition continues to improve image tagging, TagSense is an attempt to embrace additional dimensions of sensing towards this end goal. Performance comparison with Apple iPhoto and Google Picasa shows that such an out-of-band approach is valuable, especially with increasing device density and greater sophistication in sensing/learning algorith...

• Type: Journal
• Year: 2011
• Where: MOBISYS
• Authors: Chuan Qin, Xuan Bao, Romit Roy Choudhury, Srihari Nelakuditi
• Keywords: Computer Communication Networks, Computer Networks, Google Picasa, MOBISYS 2011, Networking Research Group