Name-It: Naming and Detecting Faces in Video by the Integration of Image and Natural Language Processing

We have been developing Name-It, a system that associates faces and names in news videos. First, as the only knowledge source, the system is given news videos which include image sequences and transcripts obtained from audiotracks orclosed captiontexts. The system can theneither infer the name of a given face and output the name candidates, or can locate the faces in news videos by a name. To accomplish this task, the system extracts faces from image sequences and names from transcripts, both of which might correspond to key persons in news topics. The proposed system takes full advantage of advanced image and natural language processing. The image processing contributesto the extraction of face sequences which provide rich information for face-name association. The processing also helps to select the best frontal view ofa face in a face sequence to enhance the face identification which is required for the processing. On the other hand, the natural language processing effectively ext...

• Type: Conference
• Year: 1997
• Where: IJCAI
• Authors: Shin'ichi Satoh, Yuichi Nakamura, Takeo Kanade
• Keywords: Face Sequence, IJCAI 1997, IJCAI 2007, Image Sequences, Natural Language Processing