Text-to-Video: Story Illustration from Online Photo Collections

Abstract. We present a first system to semi-automatically create a visual representation for a given, short text. We first parse the input text, decompose it into suitable units, and construct meaningful search terms. Using these search terms we retrieve a set of candidate images from online photo collections. We then select the final images in a user-assisted process and automatically create a storyboard or photomatic animation. We demonstrate promising initial results on several types of texts. Three blind mice. Three blind mice. See how they run. See how they run. They all ran after the farmer’s wife, Who cut off their tails with a carving knife, Did you ever see such a sight in your life, As three blind mice?

• Type: Journal
• Year: 2010
• Where: KES
• Authors: Katharina Schwarz, Pavel Rojtberg, Joachim Caspar, Iryna Gurevych, Michael Goesele, Hendrik P. A. Lensch
• Keywords: Blind Mice, Information Technology, KES 2010, Search Terms, Three Blind Mice