Semantic Context Modeling with Maximal Margin Conditional Random Fields for Automatic Image Annotation

Context modeling for Vision Recognition and Automatic Image Annotation (AIA) has attracted increasing attentions in recent years. For various contextual information and resources, semantic context has been exploited in AIA and brings promising results. However, previous works either casted the problem into structural classification or adopted multi-layer modeling, which suffer from the problems of scalability or model efficiency. In this paper, we propose a novel discriminative Conditional Random Field (CRF) model for semantic context modeling in AIA, which is built over semantic concepts and treats an image as a whole observation without segmentation. Our model captures the interactions between semantic concepts from both semantic level and visual level in an integrated manner. Specifically, we employ graph structure to model contextual relationships between semantic concepts. The potential functions are designed based on linear discriminative models, which enables us to propose a...

• Type: Conference
• Year: 2010
• Where: CVPR
• Authors: Yu Xiang, Xiangdong Zhou, Zuotao Liu, Tat-seng chuats, Chong-Wah Ngo
• Keywords: Computer Vision, Context Modeling, CVPR 2010, Semantic Concepts, Semantic Context