Automatic Detection of Signs with Affine Transformation

In this paper, we propose an approach for detecting signs from natural scenes. The approach efficiently embeds multiresolution, adaptive search, and affine rectification algorithms in a hierarchical framework, with different emphases at each layer. We combine multi-resolution and multi-scale edge detection techniques to effectively detect text in different sizes. Different from the existing approaches, by using the cues from text inside the image, we introduce affine rectification transformation to recover deformation of the text region caused by an inappropriate camera view angle. This procedure can significantly improve text detection rate and OCR (Optical Character Recognition) accuracy. Experimental results have demonstrated feasibility of the proposed algorithms. We have applied the proposed approach to a Chinese sign translation system, which can automatically detect Chinese text input from a camera, recognize, and translate the recognized text into English or voice stream.

• Type: Conference
• Year: 2002
• Where: WACV
• Authors: Xilin Chen, Jie Yang, Jing Zhang, Alex Waibel
• Keywords: Affine Rectification, Affine Rectification Algorithms, Affine Rectification Transformation, Computer Vision, WACV 2002