Augmented video streams display information within the context of the physical environment. In contrast to Augmented Reality, they do not require special equipment, they can support many users and are location-independent. In this paper we are exploring the potentials of augmented video streams for remote participation. We present our design considerations for remote participation user interfaces, briefly describe their development and explain the design of three different application scenarios: watching a pervasive game, observing the quality of a production process and exploring interactive science exhibits. The paper also discusses how to develop high quality augmented video streams along with which information and control options are required in order to obtain a viable remote participation interface. Keywords Augmented reality, augmented video streams, video content/communications ACM Classification Keywords