Abstract— Situated agents engaged in open systems continually face with external events requiring adequate services and behavioral responses. In these conditions agents should be able to improve their adaptivity over time, namely 1) to deal with and anticipate relevant changes and critical situations, 2) to temporally define relative priorities between goals varying their importance over time and 3) to use informational feedback to learn from experience and become better at achieving their goals. This work provides an insight to model goal directed agents with these adaptive and anticipatory abilities, based on context awareness and growing experience at achieving their activities. We propose an approach by which affective states are placed as an integrated control mechanism in order to tight different processes and computational modules underlying reasoning.