This paper proposes a new background subtraction method for detecting moving objects from a time-varied background. While background subtraction has traditionally worked well for stationary backgrounds; for a nonstationary viewing sensor, motion compensation can be applied but is difficult to realize to sufficient pixel accuracy in practice. The problem is further compounded when the moving objects are small, since the pixel error in motion compensating the background will subsume the small targets. A Spatial Distribution of Gaussians (SDG) model is proposed to deal with moving object detection having motion compensation approximated. The distribution of each background pixel is temporally and spatially modeled. Based on this statistical model, a pixel in the current frame is classified as belonging to the foreground or background. For this system to perform under lighting and environmental changes over an extended period of time, the background distribution must be updated with each ...