Putting active learning into multimedia applications: dynamic definition and refinement of concept classifiers

The authors developed an extensible system for video exploitation that puts the user in control to better accommodate novel situations and source material. Visually dense displays of thumbnail imagery in storyboard views are used for shot-based video exploration and retrieval. The user can identify a need for a class of audiovisual detection, adeptly and fluently supply training material for that class, and iteratively evaluate and improve the resulting automatic classification produced via multiple modality active learning and SVM. By iteratively reviewing the output of the classifier and updating the positive and negative training samples with less effort than typical for relevance feedback systems, the user can play an active role in directing the classification process while still needing to truth only a very small percentage of the multimedia data set. Examples are given illustrating the iterative creation of a classifier for a concept of interest to be included in subsequent inv...

• Type: Conference
• Year: 2005
• Where: MM
• Authors: Ming-yu Chen, Michael G. Christel, Alexander G. Hauptmann, Howard D. Wactlar
• Keywords: Active Learning, MM 2005, Modality Active Learning, User