Can social tagged images aid concept-based video search?

This paper seeks to unravel whether commonly available social tagged images can be exploited as a training resource for concept-based video search. Since social tags are known to be ambiguous, overly personalized, and often error prone, we place special emphasis on the role of disambiguation. We present a systematic experimental study that evaluates concept detectors based on social tagged images, and their disambiguated versions, in three application scenarios: withindomain, cross-domain, and together with an interacting user. The results indicate that social tagged images can aid conceptbased video search indeed, especially after disambiguation and when used in an interactive video retrieval setting. These results open-up interesting avenues for future research.

• Type: Journal
• Year: 2009
• Where: ICMCS
• Authors: Arjan T. Setz, Cees G. M. Snoek
• Keywords: Concept-based Video Search, ICMCS 2009, Multimedia, Social Tagged Images, Video Search