We present a background subtraction algorithm aimed at efciency and robustness to common sources of disturbance such as illumination changes, camera gain and exposure variations, noise. The approach relies on modeling the local effect of disturbance factors on a neighborhood of pixel intensities as a second-degree polynomial transformation plus additive gaussian noise. This allows for classifying pixels as changed or unchanged by a simple least-squares polynomial tting procedure. Experimental results prove that the approach is state-of-the-art in challenging sequences characterized by sources of disturbance yielding sudden and strong background appearance changes.