The Case of the Duplicate Documents Measurement, Search, and Science

Many of the documents in large text collections are duplicates and versions of each other. In recent research, we developed new methods for finding such duplicates; however, as there was no directly comparable prior work, we had no measure of whether we had succeeded. Worse, the concept of "duplicate" not only proved difficult to define, but on reflection was not logically defensible. Our investigation highlighted a paradox of computer science research: objective measurement of outcomes involves a subjective choice of preferred measure; and attempts to define measures can easily founder in circular reasoning. Also, some measures are abstractions that simplify complex real-world phenomena, so success by a measure may not be meaningful outside the context of the research. These are not merely academic concerns, but are significant problems in the design of research projects. In this paper, the case of the duplicate documents is used to explore whether and when it is reasonable ...

• Type: Conference
• Year: 2006
• Where: APWEB
• Authors: Justin Zobel, Yaniv Bernstein
• Keywords: APWEB 2006, Comparable Prior Work, Complex Real-world Phenomena, Internet Technology, Large Text Collections