: Monte Carlo Study of Taxonomy Evaluation Alexander Ulanov, Georgy Shevlyakov, Nikolay Lyubomishchenko, Pankaj Mehra, Vladimir Polutin HP Laboratories HPL-2010-147 Taxonomy evaluation, taxonomy benchmarks The problems of taxonomy evaluation criteria comparison and corresponding benchmark creation are considered. The classes of Primitive Ideal Taxonomies (PITs), their WordNet and disrupted versions are proposed as the sets of benchmark taxonomies for the comparison of taxonomy evaluation methods. For WordNet PITs and their perturbations, the performances of the structure-based PageRank, FloorRank, and the corpusbased Information Content criteria are studied in Monte Carlo experiment. It is shown that the proposed approach can be used for the ranking of taxonomy evaluation criteria. External Posting Date: October 6, 2010 [Fulltext] Approved for External Publication Internal Posting Date: October 6, 2010 [Fulltext] To be published and presented at WeBS 2010, Bilbao, Spain. Copyright WeB...