Finding Person X: Correlating Names with Visual Appearances

People as news subjects carry rich semantics in broadcast news video and therefore finding a named person in the video is a major challenge for video retrieval. This task can be achieved by exploiting the multi-modal information in videos, including transcript, video structure, and visual features. We propose a comprehensive approach for finding specific persons in broadcast news videos by exploring various clues such as names occurred in the transcript, face information, anchor scenes, and most importantly, the timing pattern between names and people. Experiments on the TRECVID 2003 dataset show that our approach achieves high performance.

• Type: Conference
• Year: 2004
• Where: CIVR
• Authors: Jun Yang 0003, Ming-yu Chen, Alexander G. Hauptmann
• Keywords: CIVR 2004, Image Analysis, TRECVID 2003 Dataset, Video Retrieval, Video Structure