Mosaic-based figure-ground segmentation along with static segmentation by mean shift

This work deals with the problem of backgroundforeground segmentation in video scenes. We propose an approach that makes use of feature extraction and matching, robust estimation, background mosaic generation, mosaic back-projection, and segmentation. We make contributions in each of these steps. SIFT features are extracted from the video and then, features between consecutive frames are matched. There are mismatches as well as errors in the feature location. To surmount this, we use a robust approach that employs a modified version of the RANSAC algorithm and weighted total least squares. Knowing the global motion allows creating an initial foreground segmentation and the generation of a mosaic mainly using background data. The moving object extraction is done by combining a mean shift-based frame segmentation along with the information given by the error of the mosaic back-projection into each frame. KEY WORDS SIFT, RANSAC, mosaic, foreground extraction.

• Type: Conference
• Year: 2007
• Where: SIP
• Authors: J. Sole, Yu Huang, Joan Llach
• Keywords: Background Mosaic Generation, Image Processing, Initial Foreground Segmentation, Mosaic Back-projection, SIP 2007