TalkMiner: a lecture webcast search engine

The design and implementation of a search engine for lecture webcasts is described. A searchable text index is created allowing users to locate material within lecture videos found on a variety of websites such as YouTube and Berkeley webcasts. The index is created from words on the presentation slides appearing in the video along with any associated such as the title and abstract when available. The video is analyzed to identify a set of distinct slide images, to which OCR and lexical processes are applied which in turn generate a list of indexable terms. Several problems were discovered when trying to identify distinct slides in the video stream. For example, picture-inpicture compositing of a speaker and a presentation slide, switching cameras, and slide builds confuse basic framedifferencing algorithms for extracting keyframe slide images. Algorithms are described that improve slide identification. A prototype system was built to test the algorithms and the utility of the search e...

• Type: Conference
• Year: 2010
• Where: MM
• Authors: John Adcock, Matthew Cooper, Laurent Denoue, Hamed Pirsiavash, Lawrence A. Rowe
• Keywords: Lecture, Lecture Videos, MM 2010, Multimedia, Search Engine