Video-Based Face Recognition Using Probabilistic Appearance Manifolds

This paper presents a novel method to model and recognize human faces in video sequences. Each registered person is represented by a low-dimensional appearance manifold in the ambient image space. The complex nonlinear appearance manifold expressed as a collection of subsets (named pose manifolds), and the connectivity among them. Each pose manifold is approximated by an affine plane. To construct this representation, exemplars are sampled from videos, and these exemplars are clustered with a K-means algorithm; each cluster is represented as a plane computed through principal component analysis (PCA). The connectivity between the pose manifolds encodes the transition probability between images in each of the pose manifold and is learned from a training video sequences. A maximum a posteriori formulation is presented for face recognition in test video sequences by integrating the likelihood that the input image comes from a particular pose manifold and the transition probability to thi...

• Type: Conference
• Year: 2003
• Where: CVPR
• Authors: Kuang-Chih Lee, Jeffrey Ho, Ming-Hsuan Yang, David J. Kriegman
• Keywords: Computer Vision, CVPR 2003, Low-dimensional Appearance Manifold, Particular Pose Manifold, Pose Manifold, Pose Manifolds, Video Sequences