Building and Using a Semantivisual Image Hierarchy

A semantically meaningful image hierarchy can ease the human effort in organizing thousands and millions of pictures (e.g., personal albums), and help to improve performance of end tasks such as image annotation and classification. Previous work has focused on using either lowlevel image features or textual tags to build image hierarchies, resulting in limited success in their general usage. In this paper, we propose a method to automatically discover the "semantivisual" image hierarchy by incorporating both image and tag information. This hierarchy encodes a general-to-specific image relationship. We pay particular attention to quantifying the effectiveness of the learned hierarchy, as well as comparing our method with others in the end-task applications. Our experiments show that humans find our semantivisual image hierarchy more effective than those solely based on texts or low-level visual features. And using the constructed image hierarchy as a knowledge ontology, our a...

• Type: Conference
• Year: 2010
• Where: CVPR
• Authors: Li-Jia Li, Chong Wang, Yongwhan Lim, David Blei, Li Fei-Fei
• Keywords: Computer Vision, CVPR 2010, Image Hierarchy, Meaningful Image Hierarchy, Semantivisual Image Hierarchy