Stream Processing on the Grid: an Array Stream Transforming Language

Specific requirements of stream processing on the Grid are discussed. We argue that when the stream processing paradigm is used for cluster computing, the processing components can be coded in the form of data-parallel recurrence relations with stream synchronization and filtering at the interfaces. We propose a programming language ASTL in which such components can be written and describe some of its key features. Our approach enables distributed type inference which guarantees correct typing of the whole distributed application. Finally we discuss the stream network architecture and identify issues requiring Grid support.

• Type: Conference
• Year: 2003
• Where: SNPD
• Authors: Alexander V. Shafarenko
• Keywords: Data-parallel Recurrence Relations, SNPD 2003, SNPD 2007, Stream Processing, Stream Processing Paradigm