—Video enhancement has played very important roles in many applications. However, most existing enhancement methods only focus on the spatial quality within a frame while the temporal qualities of the enhanced video are often unguaranteed. In this paper, a new algorithm is proposed for video enhancement. The proposed algorithm introduces new temporal constraints and combines them with the spatial constraints such that both the spatial and temporal qualities of the video can be improved. Two strategies are proposed for including the temporal constraints. Experimental results demonstrate the effectiveness of the proposed algorithm.