One of the big issues facing current content-based image retrieval is how to automatically extract the high-level concepts from images. In this paper, we present an efficient system that automatically extracts the high-level concepts from images by using ontologies and semantic inference rules. In our method, MPEG-7 visual descriptors are used to extract the visual features of image, and the visual features are mapped to semi-concepts via the mapping algorithm. We also build the visual and animal ontologies to bridge the semantic gap. The visual ontology allows the definition of relationships among the classes describing the visual features and has the values of semi-concepts as the property values. The animal ontology can be exploited to identify the highlevel concept in an image. Also, the semantic inference rules are applied to the ontologies to extract the high-level concept. Finally, we evaluate the proposed system using the image data set including various animal objects and disc...