Syntactic Similarity of Web Documents

This paper presents and compares two methods for evaluating the syntactic similarity between documents. The first method uses the Patricia tree, constructed from the original document, and the similarity is computed searching the text of each candidate document in the tree. The second method uses shingles concept to obtain the similarity measure for every document pairs, and each shingle from the original document is inserted in a hash table, where shingles of each candidate document are searched. Given an original document and some candidates, two methods find documents that have some similarity relationship with the original document. Experimental results were obtained by using a plagiarized documents generator system, from 900 documents collected from the Web. Considering the arithmetic average of the absolute differences between the expected and obtained similarity, the algorithm that uses shingles obtained a performance of ½¿± and the algorithm that uses Patricia tree a perf...

• Type: Conference
• Year: 2003
• Where: LAWEB
• Authors: Álvaro R. Pereira Jr., Nivio Ziviani
• Keywords: Candidate Document, Human Computer Interaction, Internet Technology, LAWEB 2003, Original Document, Patricia Tree