GaZIR: gaze-based zooming interface for image retrieval

We introduce GaZIR, a gaze-based interface for browsing and searching for images. The system computes on-line predictions of relevance of images based on implicit feedback, and when the user zooms in, the images predicted to be the most relevant are brought out. The key novelty is that the relevance feedback is inferred from implicit cues obtained in real-time from the gaze pattern, using an estimator learned during a separate training phase. The natural zooming interface can be connected to any content-based information retrieval engine operating on user feedback. We show with experiments on one engine that there is sufficient amount of information in the gaze patterns to make the estimated relevance feedback a viable choice to complement or even replace explicit feedback by pointing-and-clicking. Categories and Subject Descriptors H.3.3 [Information Storage and Retrieval]: Information Search and Retrieval—Relevance feedback, Search process; H.5.2 [Information Interfaces and Repres...

• Type: Conference
• Year: 2009
• Where: ICMI
• Authors: László Kozma, Arto Klami, Samuel Kaski
• Keywords: Biometrics, Gaze-based Interface, ICMI 2009, Implicit Feedback, Relevance Feedback