This paper describes attempts at constructing an automatic sleep stage classifier using EEG recordings. Three different feature extraction schemes were compared together with two different pattern classifiers, the recently introduced support vector machine and the well known knearest neighbor classifier. Using estimates of posterior probabilities for each of the sleep stages it was possible to devise a simple post-processing rule which leads to improved accuracy. Compared to a human expert the accuracy of the best classifier is 81%.