Gaze-contingent temporal filtering of video

We describe an algorithm for manipulating the temporal resolution of a video in real time, contingent upon the viewer’s direction of gaze. The purpose of this work is to study the effect that a controlled manipulation of the temporal frequency content in realworld scenes has on eye movements. We build on the work of Perry and Geisler [1998; 2002], who manipulate spatial resolution as a function of gaze direction, allowing them to mimic the resolution distribution of the human retina or to simulate the effect of various diseases (e.g. glaucoma). Our temporal filtering algorithm is similar to that of Perry and Geisler in that we interpolate between the levels of a multiresolution pyramid. However, in our case, the pyramid is built along the temporal dimension, and this requires careful management of the buffering of video frames and of the order in which the filtering operations are performed. On a standard personal computer, the algorithm achieves real-time performance (30 frames p...

• Type: Conference
• Year: 2006
• Where: ETRA
• Authors: Martin Böhme, Michael Dorr, Thomas Martinetz, Erhardt Barth
• Keywords: Algorithm, ETRA 2006, Eye Tracking Research, Temporal Frequency Content, Temporal filtering Algorithm