Automatic Construction of an Action Video Shot Database using Web Videos

There are a huge number of videos with text tags on the Web nowadays. In this paper, we propose a method of automatically extracting from Web videos video shots corresponding to specific actions with just only providing action keywords such as “walking” and “eating”. The proposed method consists of three steps: (1) tagbased video selection, (2) segmenting videos into shots and extracting features from the shots, and (3) visual-featurebased video shot selection with tag-based scores taken into account. Firstly, we gather video IDs and tag lists for 1000 Web videos corresponding to given keywords via Web API, and we calculate tag relevance scores for each video using a tag-co-occurrence dictionary which is constructed in advance. Secondly, we fetch the top 200 videos from the Web in the descending order of the tag relevance scores, and segment each downloaded video into several shots. From each shot we extract spatio-temporal features, global motion features and appearance feat...

• Type: Journal
• Year: 2011
• Where: ICCV
• Authors: Do Hang Nga, Keiji Yanai
• Keywords: Appearance Features, Computer Vision, ICCV 2011, Similarity Matrix, Video Shots