An application for content-based annotation and retrieval of videos can be found in the sport domain, where videos are annotated in order to produce short summaries for news and sports programmes, edited reusing the video clips that show important highlights and the players involved in the most interesting actions. The problem of detecting and recognizing faces in broadcast videos is a widely studied topic. However, in the case of sports videos in general, and soccer videos in particular, the current techniques are not suitable for the task of face detection and recognition, due to the high variations in pose, illumination, scale and occlusion that may happen in an uncontrolled environment. In this paper we present an algorithm that improves face detection and an algorithm for face recognition, with associated metric, that copes with these problems. The first algorithm adds a filtering stage to the Viola and Jones face detection algorithm, the second algorithm exploits i) local featu...