Face Recognition in Unconstrained Videos with Matched Background Similarity

Recognizing faces in unconstrained videos is a task of mounting importance. While obviously related to face recognition in still images, it has its own unique characteristics and algorithmic requirements. Over the years several methods have been suggested for this problem, and a few benchmark data sets have been assembled to facilitate its study. However, there is a sizable gap between the actual application needs and the current state of the art. In this paper we make the following contributions. (a) We present a comprehensive database of labeled videos of faces in challenging, uncontrolled conditions (i.e., ‘in the wild’), the ‘YouTube Faces’ database, along with benchmark, pairmatching tests1 . (b) We employ our benchmark to survey and compare the performance of a large variety of existing video face recognition techniques. Finally, (c) we describe a novel set-to-set similarity measure, the Matched Background Similarity (MBGS). This similarity is shown to considerably impro...

• Type: Journal
• Year: 2011
• Where: CVPR
• Authors: Lior Wolf, Tal Hassner, Itay Maoz
• Keywords: Benchmark Data Sets, Computer Vision, CVPR 2011, Similarity Measure, Unconstrained Videos