Affective computing systems face challenges in relating objective measures with subjective human experiences. Many systems have either focused on objective measures as a substitute for subjective experience (e.g. skin conductance as a direct representation of arousal) or have abandoned objective measures to focus purely on subjective experience. In this paper, we explore how to negotiate the relationship between objective signals and subjective experiences by highlighting the role of human interpretation. Our approach is informed by a reflective analysis drawing on the arts and the humanities and by a participatory study examining the emergence of emotional meaning. We demonstrate the potential of our approach for interactive affective systems through a series of conceptual designs that embody these understandings. Categories and Subject Descriptors H.5.m. Information Interfaces and Presentation (e.g., HCI): Miscellaneous. K.4.2. Computers and Society: Miscellaneous. General Terms Des...