How speech/text alignment benefits web-based learning

This demonstration presents an integrated web-based synchronized scenario for many-to-one cross-media correlations between speech (an EFL, English as Foreign Language, lecture with free-style lecturing behaviors) and the corresponding textual content. The analysis/presentation of the temporal correlations enable the vivid web-based language learning through the interactive functions: browsing speech via content, word-by-word pointer guidance, synchronized scrolling/highlighting, and listening training mode. We regularly analyze and repackage the multimedia content of VoA (Voice of America) [1], ICRT (International Community Radio Taipei) [2], and Online Lectures in our University [3]. Through the subjective experiments, this repackaged synchronized speech/text content does facilitate the learning for EFL learners. Categories and Subject Descriptors K.3.1 [Computers and Education]: Computer Uses in Education – computer-assisted instruction, distance learning. General Terms Design and...

• Type: Conference
• Year: 2005
• Where: MM
• Authors: Sheng-Wei Li, Hao-Tung Lin, Herng-Yow Chen
• Keywords: Cross-media Correlation, Many-to-one Cross-media Correlations, MM 2005, Web-based Synchronized Scenario