Combining anchor text categorization and graph analysis for paid link detection

In order to artificially boost the rank of commercial pages in search engine results, search engine optimizers pay for links to these pages on other websites. Identifying paid links is important for a web search engine to produce highly relevant results. In this paper we introduce a novel method of identifying such links. We start with training a classifier of anchor text topics and analyzing web pages for diversity of their outgoing commercial links. Then we use this information and analyze link graph of the Russian Web to find pages that sell links and sites that buy links and to identify the paid links. Testing on manually marked samples showed high efficiency of the algorithm. Categories and Subject Descriptors H.3.3 [Information Search and Retrieval]: Information Filtering. General Terms Algorithms, Design, Experimentation. Keywords Search engines, language model, categorization, link analysis, machine learning, web mining.

• Type: Conference
• Year: 2009
• Where: WWW
• Authors: Kirill Nikolaev, Ekaterina Zudina, Andrey Gorshkov
• Keywords: Analyze Link Graph, Internet Technology, Outgoing Commercial Links, Web Search Engine, WWW 2009