Spatial-temporal attention analysis for home video

In this paper, by considering the multiple spatial-temporal characteristic of visual perception system, we propose a novel home video attention analysis method. Firstly, each frame of the video is segmented into regions which are more informative than pixels and image blocks. Then the saliency of each region is analyzed by combining static, motion and location attentions. Finally a region based saliency map is generated for each frame, and an attention score curve is obtained for the video clip by combining attention scores of all regions in each frame. Both of them can be utilized in wide applications. This method takes advantage of the properties of human visual perception and can well present the attention information of home videos. Experimental results show the effectiveness of this approach.

• Type: Conference
• Year: 2008
• Where: ICMCS
• Authors: Xuekan Qiu, Shuqiang Jiang, Huiying Liu, Qingming Huang, Longbing Cao
• Keywords: Attention Scores, Home Video Attention, ICMCS 2008, Multimedia, Visual Perception