In this paper, we present a new method for removing texture in images using a smoothing rotating filter. From this filter, a bank of smoothed images provides pixel signals able to classify a pixel as a texture pixel, a homogenous region pixel or an edge pixel. Then, we introduce a new method for anisotropic diffusion which controls accurately the diffusion near edge and corner points and diffuses isotropically inside textured regions. Several results applied on real images and a comparison with anisotropic diffusion methods show that our model is able to remove the texture and control the diffusion.