We propose a key frame extraction mechanism to aid the Structure from Motion (SfM) problem when dealing with image sequences from video cameras. Due to high frame rates (15 frames per second or more) the baseline between frames can be very small and the number of frames can become unpractical to deal with effectively. The mechanism described in this paper is a preprocessing step designed to make an ideal image sequence from larger sequence of video frame data. Based on a proven tracking mechanism, the algorithm remains quite simple yet effective for identifying and extracting salient frame data for the SfM problem in effect removing degeneracy cases.