The rapid growth of the Internet and digitized content made video distribution simpler. Hence the need for video data protection is on the rise. In this paper, we propose a secure and computationally feasible video encryption algorithm based on the principle of Secret Sharing. The strength of the DC is distributed among the AC values based on Shamir’s Secret Sharing (SSS) scheme. The proposed algorithm guarantees security, fastness and error tolerance with a small increase in video size.