Using Content-Based and Link-Based Analysis in Building Vertical Search Engines

This paper reports our research in the Web page filtering process in specialized search engine development. We propose a machine-learning-based approach that combines Web content analysis and Web structure analysis. Instead of a bag of words, each Web page is represented by a set of contentbased and link-based features, which can be used as the input for various machine learning algorithms. The proposed approach was implemented using both a feedforward/backpropagation neural network and a support vector machine. An evaluation study was conducted and showed that the proposed approaches performed better than the benchmark approaches.

• Type: Conference
• Year: 2004
• Where: ICADL
• Authors: Michael Chau, Hsinchun Chen
• Keywords: ICADL 2004, Web Content Analysis, Web Page, Web Structure Analysis