Semantic texton forests for image categorization and segmentation

We propose semantic texton forests, efficient and powerful new low-level features. These are ensembles of decision trees that act directly on image pixels, and therefore do not need the expensive computation of filter-bank responses or local descriptors. They are extremely fast to both train and test, especially compared with k-means clustering and nearest-neighbor assignment of feature descriptors. The nodes in the trees provide (i) an implicit hierarchical clustering into semantic textons, and (ii) an explicit local classification estimate. Our second contribution, the bag of semantic textons, combines a histogram of semantic textons over an image region with a region prior category distribution. The bag of semantic textons is computed over the whole image for categorization, and over local rectangular regions for segmentation. Including both histogram and region prior allows our segmentation algorithm to exploit both textural and semantic context. Our third contribution is an image...

• Type: Conference
• Year: 2008
• Where: CVPR
• Authors: Jamie Shotton, Matthew Johnson, Roberto Cipolla
• Keywords: Computer Vision, CVPR 2008, Segmentation Accuracy, Semantic Context, Semantic Texton Forests, Semantic Textons, Voc 2007 Segmentation