Feature selection is attracted much interest from researchers in many fields such as pattern recognition and data mining. In this paper, a novel algorithm for feature selection is developed. The proposed algorithm uses the standard linear SVM algorithm and is performed in an iterative way. Feature selection is carried out by assigning weights to features. Experimental results on UCI data set and face images confirm the feasibility and validation of the proposed method.