A study of image-based music composition

Visual and auditory forms have some noticeable associations that can inspire similar cognitive and aesthetical experiences. This paper presents a study on the possibilities of applying low-level visual-auditory associations to music generation. A few methods are implemented to directly convert visual features extracted from images into musical elements (pitch, duration, and chord). Some initial results suggest a high potential of composing interesting music along this direction† . Possible applications of this study include getting new ideas for music composers and generating accompanying music in various contexts.

• Type: Conference
• Year: 2008
• Where: ICMCS
• Authors: Xiaoying Wu, Ze-Nian Li
• Keywords: ICMCS 2008, Low-level Visual-auditory Associations, Multimedia, Music, Noticeable Associations