Generalized Assorted Pixel Camera: Postcapture Control of Resolution, Dynamic Range, and Spectrum

We propose the concept of a generalized assorted pixel (GAP) camera, which enables the user to capture a single image of a scene and, after the fact, control the tradeoff between spatial resolution, dynamic range and spectral detail. The GAP camera uses a complex array (or mosaic) of color filters. A major problem with using such an array is that the captured image is severely under-sampled for at least some of the filter types. This leads to reconstructed images with strong aliasing. We make four contributions in this paper: 1) we present a comprehensive optimization method to arrive at the spatial and spectral layout of the color filter array of a GAP camera. 2) We develop a novel algorithm for reconstructing the under-sampled channels of the image while minimizing aliasing artifacts. 3) We demonstrate how the user can capture a single image and then control the tradeoff of spatial resolution to generate a variety of images, including monochrome, high dynamic range (HDR) monochrome, ...

• Type: Journal
• Year: 2010
• Where: TIP
• Authors: Fumihito Yasuma, Tomoo Mitsunaga, Daisuke Iso, Shree K. Nayar
• Keywords: Color Filter, Education, GAP Camera, Images, TIP 2010