In this paper, a novel algorithm for foreground detection and shadow removal is presented. The proposed method employs a region-based approach by processing two foregrounds resulted from gradientand color-based background subtraction methods. The performance of the system is compared against conventional approaches for five indoor and outdoor video sequences. Experimental results confirm that the detection rate exceeds 90%, and the robustness is greatly improved.