In this paper we propose an ontology based representation of the affective states for context aware applications that allows expressing the complex relations that are among the affective states and between these and the other context elements. This representation is open to map different affective spaces; basic and secondary states relation (using Fuzzy Logic), the relation between these states and other context elements as location, time, person, activity etc. The proposed affective context model is encoded in OWL. Due to difficulties in direct detection of the secondary affective states we propose a method to infer the characteristic values of these states from other context elements' values. The deduces states are used here to improve the behavior of a Context Aware Museum Guide in order to react more intuitively and more intelligent by taking into account the user's affective states.