Interactive viewpoint-space navigation for visual-audio exhibition of painting

In this paper, we present a system for exhibiting a Chinese landscape painting about 900 years old. There are three parts in our system: (1) we allocate a voice dubbing or background music, which is treated as a point sound source, onto the 2D painting and obtain its position in the 2D space. All of the audio data are then located in a 3D hidden space, by projecting their 2D positions to the 3D space through a projection model. (2) A two-layer directed graph structure is proposed to well organize the audio data in a 4D space (with 1D temporal and 3D spatial). (3) The exhibition is defined as an active exploration in a viewpoint space, which faces both the image and the 3D world where the sound sources reside. The 3D space and the two-layer graph structure generate a natural and meaningful stereo audio field. Meanwhile, compared to videos with guided walk through, the active exploration makes the exhibition more attractive. Keywords-- Painting exhibition, viewpoint space, graph structu...

• Type: Journal
• Year: 2010
• Where: ICMCS
• Authors: Wei Ma, Yang Liu, Yizhou Wang, Yingqing Xu, Hongbin Zha, Wen Gao
• Keywords: Graph Structure, ICMCS 2010, Multimedia, Space, Stereo Audio Field