Sciweavers

ICPR
2010
IEEE

Crossmodal Matching of Speakers Using Lip and Voice Features in Temporally Non-Overlapping Audio and Video Streams

14 years 2 months ago
Crossmodal Matching of Speakers Using Lip and Voice Features in Temporally Non-Overlapping Audio and Video Streams
Person identification using audio (speech) and visual (facial appearance, static or dynamic) modalities, either independently or jointly, is a thoroughly investigated problem in pattern recognition. In this work, we explore a novel task : person identification in a cross-modal scenario, i.e., matching the speaker in an audio recording to the same speaker in a video recording, where the two recordings have been made during different sessions, using speaker specific information which is common to both the audio and video modalities. Several recent psychological studies have shown how humans can indeed perform this task with an accuracy significantly higher than chance. Here we propose two systems which can solve this task comparably well, using purely pattern recognition techniques. We hypothesize that such systems could be put to practical use in multimodal biometric and surveillance systems. Keywords-Multi-modal biometrics, audio-visual speaker recognition, crossmodal matching, audio a...
Anindya Roy, Sebastien Marcel
Added 08 Sep 2010
Updated 08 Sep 2010
Type Conference
Year 2010
Where ICPR
Authors Anindya Roy, Sebastien Marcel
Comments (0)