This paper presents a new two-stage approach to impulse noise removal for color image. The first step is the impulse detection, in which the so-called Rank-Ordered Absolute Differences (ROAD) is used to determine whether a pixel is impulsive to be removed. The second step does noise suppression based on maximizing the proposed pixel similarity measure that considers both magnitude and angular information of pixel vectors’ difference. Experimental results show that our method can remove impulse noise effectively, and in the meantime can preserve chromaticity and image details very well.