This is the first paper that proposes automatic image annotation using the semantics of XML. In this paper, we propose XPRM - XML Path based Relevance Model for automatic image annotation. Our experimental results show that the proposed model has considerable advantage over single word annotations in performing automatic semantic annotation.