This paper presents a method for incrementally segmenting images over time using both intensity and motion information. This is done by formulating a model of physically signi cant image resgions using local constraints on intensity and motion and then nding the optimal segmentation over time using an incremental stochastic minimization technique. The result is a robust and dynamic segmentation of the scene over a sequence of images. The approach has a number of bene ts. First, discontinuities are extracted and tracked simultaneously. Second, a segmentation is always available and it improves over time. Finally, by combining motion and intensity, the structural properties of discontinuities can be recovered; that is, discontinuities can be classi ed as surface markings or actual surface boundaries.
Michael J. Black