This paper presents a learning-based approach to segment postal address blocks where the learning step uses only one pair of images (a sample image and its ideal segmented solution). First, this approach learns the available knowledge among pixels (each gray level) in an input image and its corresponding output in the ideal segmented solution. A classification array is generated which is re-utilized during the segmentation of new images. Features are extracted and updated by means of an adaptive square neighborhood. At the moment of new image segmentation, the submitted images are segmented by means of a k-Nearest Neighbor (k-NN) algorithm that seeks, for each pixel, the best solution in the classification array. Tests on a database of 200 complex envelope images were performed and a pixel to pixel accuracy measure validates the new approach. Results compared to other approaches for the same database show the efficiency and performance of the proposed learning-based approach. Success ...