Clustering Art

We extend a recently developed method [1] for learning the semantics of image databases using text and pictures. We incorporate statistical natural language processing in order to deal with free text. We demonstrate the current system on a difficult dataset, namely 10,000 images of work from the Fine Arts Museum of San Francisco. The images include line drawings, paintings, and pictures of sculpture and ceramics. Many of the images have associated free text whose varies greatly, from physical description to interpretation and mood. We use WordNet to provide semantic grouping information and to help disambiguate word senses, as well as emphasize the hierarchical nature of semantic relationships. This allows us to impose a natural structure on the image collection, that reflects semantics to a considerable degree. Our method produces a joint probability distribution for words and picture elements. We demonstrate that this distribution can be used (a) to provide illustrations for given c...

• Type: Conference
• Year: 2001
• Where: CVPR
• Authors: Kobus Barnard, Pinar Duygulu, David A. Forsyth
• Keywords: Annotation Process, Computer Vision, CVPR 2001, Free Text, Images Include Line, Joint Probability Distribution, Semantic Grouping Information