This paper proposes an automated web site evaluation approach using machine learning to cope with ranking problems. Evaluating web sites is a significant task for web service because evaluated web sites provide useful information for users to estimate sites’ validation and popularity. Although many practical approaches have been taken to present a measuring stick for web sites, their evaluation functions are set up manually. Thus, we develop a method to obtain evaluation function using Ranking SVM and automatically rank web sites with the learned classifier. Also we conducted experiments and confirmed the effectiveness of our approach and its potential in performing high quality web site evaluation.