Capturing Multiple Illumination Conditions using Time and Color Multiplexing

Many vision and graphics problems such as relighting, structured light scanning and photometric stereo, need im- ages of a scene under a number of different illumination conditions. It is typically assumed that the scene is static. To extend such methods to dynamic scenes, dense optical flow can be used to register adjacent frames. This registra- tion becomes inaccurate if the frame rate is too low with respect to the degree of movement in the scenes. We present a general method that extends time multiplex- ing with color multiplexing in order to better handle dy- namic scenes. Our method allows for packing more illumi- nation information into a single frame, thereby reducing the number of required frames over which optical flow must be computed. Moreover, color-multiplexed frames lend them- selves better to reliably computing optical flow. We show that our method produces better results compared to time- multiplexing alone. We demonstrate its application to re- lighti...

• Type: Conference
• Year: 2009
• Where: CVPR
• Authors: Bert De Decker (Hasselt University), Jan Kautz (University College London), Tom Mertens (University of Hasselt), Philippe Bekaert (Hasselt University)
• Keywords: Color Multiplexing, Computer Vision, CVPR 2009, Multiple Illumination Conditions, Time Multiplexing