The automatic recognition of video clips is an important capability with applications in broadcast monitoring for content theft and adherence to advertisement campaign. In this paper, we present an approach for video clip recognition based on HMM and GMM for modeling video and audio streams respectively. The approach is used to model TV commercials. The recognition results of using single stream and joint models are compared. The error rate of 0.01% is achieved when the joint audiovisual processing model is employed.
Victor Kulesh, Valery A. Petrushin, Ishwar K. Seth