In this article we wish to show a method to go beyond the established approaches of human-computer interaction. We first bring a serious critique of traditional interface types, showing their major drawbacks and limitations. Promising alternatives are offered by Virtual (or: immersive) Reality (VR) and by Augmented Reality (AR). The AR design strategy enables humans to behave in a nearly natural way. Natural interaction means human action in the real world with other humans and/or with real world objects. Guided by the basic constraints of natural interaction, we derive a set of recommendations for the next generation of user interfaces: the Natural User Interface (NUI). Our approach to NUIs is discussed in form of a general framework followed by a prototype. The prototypical tool builds on video-based interaction, and supports construction and design planning. A first empirical evaluation is briefly presented.