In this paper, a new tracking algorithm, based on local minimum energy, is proposed for matching between a projected model and corresponding image features in real-time. The algorithm is simple and accurate comparing with known literature. It has added advantage of robustness to changes in lighting or background and requires only a workstation with a frame grabber card installed. By using the proposed algorithm, a real-time motion tracking is performed. In practice, rigid objects with known geometric features are to be tracked in 6 degrees of freedom arbitrary motion.