Abstract. To retrieve pictograms having semantically ambiguous interpretations, we propose a semantic relevance measure which uses pictogram interpretation words collected from a web survey. The proposed measure uses ratio and similarity information contained in a set of pictogram interpretation words to (1) retrieve pictograms having implicit meaning but not explicit interpretation word and (2) rank pictograms sharing common interpretation word(s) according to query relevancy which reflects the interpretation ratio.