Abstract. We discuss problems of signal– and symbol based representations in terms of three dilemmas which are faced in the design of each vision system. Signal- and symbol-based representations are opposite ends of a spectrum of conceivable design decisions caught at opposite sides of the dilemmas. We make inherent problems explicit and describe potential design decisions for artificial visual systems to deal with the dilemmas.