Knowledge-based fuzzy inference and neural learning are used in this paper in order to model the event recognition task in semantic video analysis. The advantage of their use is the symbolic nature of the representation of the knowledge concerning the events to be recognized. Moreover, this knowledge can be adapted with the aid of data taken from video sequences. The proposed system has been tested in soccer video sequences for detecting some complex predetermined (and represented in the form of rules) events.