Audiovisual celebrity recognition in unconstrained web videos

The number of video clips available online is growing at a tremendous pace. Conventionally, user-supplied metadata text, such as the title of the video and a set of keywords, has been the only source of indexing information for useruploaded videos. Automated extraction of video content for unconstrained and large scale video databases is a challenging and yet unsolved problem. In this paper, we present an audiovisual celebrity recognition system towards automatic tagging of unconstrained web videos. Prior work on audiovisual person recognition relied on the fact that the person in the video is speaking and the features extracted from audio and visual domain are associated with each other throughout the video. However, this assumption is not valid on unconstrained web videos. Proposed method finds the audiovisual mapping and hence improve upon the association assumption. Considering the scale of the application, all pieces of the system are trained automatically without any human super...

• Type: Journal
• Year: 2009
• Where: ICASSP
• Authors: Mehmet Emre Sargin, Hrishikesh Aradhye, Pedro J. Moreno, Ming Zhao
• Keywords: Audiovisual Celebrity Recognition, ICASSP 2009, Signal Processing, Unconstrained Web Videos, Video