In this paper we present a method for impulse noise removal that makes use of spectral clustering and graph regularization. The image is modeled as a graph and local spectral analysis is performed to identify noisy and noise free pixels. On the set of noise free pixels, a topology adapted graph regularization is performed. Experimental results show the benefits of the proposed approach regarding the standard VMF when noise proportion is high.