Bag-of-visual-words expansion using visual relatedness for video indexing

Bag-of-visual-words (BoW) has been popular for visual classification in recent years. In this paper, we propose a novel BoW expansion method to alleviate the effect of visual word correlation problem. We achieve this by diffusing the weights of visual words in BoW based on visual word relatedness, which is rigorously defined within a visual ontology. The proposed method is tested in video indexing experiment on TRECVID-2006 video retrieval benchmark, and an improvement of 7% over the traditional BoW is reported. Categories and Subject Descriptors: H.3.1 [Information Storage and Retrieval]: Content Analysis and Indexing General Terms: Algorithms, Experimentation.

• Type: Journal
• Year: 2008
• Where: SIGIR
• Authors: Yu-Gang Jiang, Chong-Wah Ngo
• Keywords: Information Technology, SIGIR 2008, Visual Word, Visual Word Correlation, Visual Word Relatedness