Applying Co-training to Clickthrough Data for Search Engine Adaptation

The information on the World Wide Web is growing without bound. Users may have very diversified preferences in the pages they target through a search engine. It is therefore a challenging task to adapt a search engine to suit the needs of a particular community of users who share similar interests. In this paper, we propose a new algorithm, Ranking SVM in a Co-training Framework (RSCF). Essentially, the RSCF algorithm takes the clickthrough data containing the items in the search result that have been clicked on by a user as an input, and generates adaptive rankers as an output. By analyzing the clickthrough data, RSCF first categorizes the data as the labelled data set, which contains the items that have been scanned already, and the unlabelled data set, which contains the items that have not yet been scanned. The labelled data is then augmented with unlabelled data to obtain a larger data set for training the rankers. We demonstrate that the RSCF algorithm produces better ranking res...

• Type: Conference
• Year: 2004
• Where: DASFAA
• Authors: Qingzhao Tan, Xiaoyong Chai, Wilfred Ng, Dik Lun Lee
• Keywords: DASFAA 2004, Data Set, Database, Ranking SVM, Search Engine