Bilingual audio-subtitle extraction using automatic segmentation of movie audio

Extraction of bilingual audio and text data is crucial for designing Speech to Speech (S2S) systems. In this work, we propose an automatic method to segment multilingual audio streams from movies. In addition, the audio streams are aligned with the corresponding subtitles. We found that the proposed method gives 89% perfectly segmented bilingual audio and 6% partially segmented bilingual audio. In addition, the mapping of the audio to the corresponding subtitles has accuracy 91%.

• Type: Journal
• Year: 2011
• Where: ICASSP
• Authors: Andreas Tsiartas, Prasanta Kumar Ghosh, Panayiotis G. Georgiou, Shrikanth Narayanan
• Keywords: Audio Streams, Bilingual Audio, Corresponding Subtitles, ICASSP 2011, Signal Processing