We propose a novel framework for constrained spectral
clustering with pairwise constraints which specify whether
two objects belong to the same cluster or not. Unlike previous
methods that modify the similarity matrix with pairwise
constraints, we adapt the spectral embedding towards
an ideal embedding as consistent with the pairwise constraints
as possible. Our formulation leads to a small
semidefinite program whose complexity is independent of
the number of objects in the data set and the number of
pairwise constraints, making it scalable to large-scale problems.
The proposed approach is applicable directly to
multi-class problems, handles both must-link and cannotlink
constraints, and can effectively propagate pairwise
constraints. Extensive experiments on real image data and
UCI data have demonstrated the efficacy of our algorithm.