— We have developed a stereo vision based obstacle detection (OD) system that can be used to detect obstacles in off-road terrain during both day and night conditions. In order to acquire enough depth estimates for reliable OD during low visibility conditions, we propose a stereo disparity (depth) estimation approach that uses fine-to-coarse selection in a stereo image pyramid. This fine-to-coarse selection is based on a novel disparity validity metric that reflects the estimation reliability. Dense three-dimensional terrain data is reconstructed from the estimated stereo disparities. In our OD methods, several geometric properties, such as the terrain slope, are inspected to distinguish between obstacles and drivable terrain. This is achieved in a robust and efficient manner by considering the inherent uncertainty in stereo depth and using a hysteresis threshold. A large and varied collection of day- and nighttime images has been used to evaluate the performance of our system. T...
Gijs Dubbelman, Wannes van der Mark, Johan C. van