In this paper, we describe MusicStory, a system that automatically creates videos to accompany music with lyrics. MusicStory uses common search engines, photo-sharing websites, and simple analysis of the dynamics and tempo of the music to create personalized photo-narratives. Video pacing and content is based on the content of the song and structure of the image repositories selected. The image associations MusicStory presents amplify the emotional experience by externalizing the imagery in song lyrics with the content found within a social network. The resulting work juxtaposes the meanings inherent in the social network with those in the song. Categories and Subject Descriptors J.5 [Arts and Humanities]: Performing arts (e.g., dance, music); H.5.3 [Information Interfaces and Presentation]: Group and Organization Interfaces—Web-based interaction General Terms Performance, Design, Human Factors Keywords Media Arts, Music Video, Network Arts, Photo Sharing, Software Agents, World Wid...
David A. Shamma, Bryan Pardo, Kristian J. Hammond