Vision-Based Behavior Prediction in Urban Traffic Environments by Scene Categorization

We propose a method for vision-based scene understanding in urban traffic environments that predicts the appropriate behavior of a human driver in a given visual scene. The method relies on a decomposition of the visual scene into its constituent objects by image segmentation and uses segmentation-based features that represent both their identity and spatial properties. We show how the behavior prediction can be naturally formulated as scene categorization problem and how ground truth behavior data for learning a classifier can be automatically generated from any monocular video sequence recorded from a moving vehicle, using structure from motion techniques. We evaluate our method both quantitatively and qualitatively on the recently proposed CamVid dataset, predicting the appropriate velocity and yaw rate of the car as well as their appropriate change for both day and dusk sequences. In particular, we investigate the impact of the underlying segmentation and the number of behavior cl...

• Type: Journal
• Year: 2010
• Where: BMVC
• Authors: Martin Heracles, Fernando Martinelli, Jannik Fritsch
• Keywords: Behavior, BMVC 2010, Computer Vision, Scene Categorization Problem, Visual Scene