Since R. Bolt's seminal "Put that there" demonstrator, more and more robust and innovative modalities can be used and empirical work on the usage of multiple modalities is now available for guiding the design of efficient and usable multimodal interfaces. This paper presents a system of patterns for capitalizing and formalizing this design knowledge about multimodal interfaces as patterns. Patterns are used for illustrating our system of patterns.