Measuring the Structural Similarity of Semistructured Documents Using Entropy

We propose a technique for measuring the structural similarity of semistructured documents based on entropy. After extracting the structural information from two documents we use either Ziv-Lempel encoding or Ziv-Merhav crossparsing to determine the entropy and consequently the similarity between the documents. To the best of our knowledge, this is the first true linear-time approach for evaluating structural similarity. In an experimental evaluation we demonstrate that the results of our algorithm in terms of clustering quality are on a par with or even better than existing approaches.

• Type: Conference
• Year: 2007
• Where: VLDB
• Authors: Sven Helmer
• Keywords: Database, VLDB 2007