This paper deals with the influence of hardware aspects of modern computer architectures to the design of software for numerical simulations. We present performance tests for various tasks arising in FEM computations and show under which circumstances performance loss can occur. Further we give key ideas for our new software package FEAST, which is especially designed for high performance computations.