MuSA.RT: music on the spiral array. real-time

We present MuSA.RT, Opus 1, a multimodal interactive system for music analysis and visualization using the Spiral Array model. Real-time MIDI input from a live performance is processed, analyzed and mapped to the 3D model, revealing tonal structures such as pitches, chords and keys. A user can concurrently navigate through the Spiral Array space using a gamepad or set the camera control to automatic pilot. The interaction among and concurrent processing of the different data streams is made possible through the Modular Flow Scheduling Middleware. Categories and Subject Descriptors H.5.5 [Information Interfaces and Presentation]: Sound and Music Computing—Systems; I.5.5 [Pattern Recognition]: Implementation—Interactive Systems; J.5 [Computer Applications]: Arts and Humanities—Performing Arts General Terms Algorithms, design, experimentation, human factors, theory Keywords Spiral Array, SAI, MFSM, music analysis, system implementation, music visualization

• Type: Conference
• Year: 2003
• Where: MM
• Authors: Elaine Chew, Alexandre R. J. François
• Keywords: MM 2003, Music Analysis, Spiral Array, Spiral Array Model