Deep networks for robust visual recognition

Deep Belief Networks (DBNs) are hierarchical generative models which have been used successfully to model high dimensional visual data. However, they are not robust to common variations such as occlusion and random noise. We explore two strategies for improving the robustness of DBNs. First, we show that a DBN with sparse connections in the first layer is more robust to variations that are not in the training set. Second, we develop a probabilistic denoising algorithm to determine a subset of the hidden layer nodes to unclamp. We show that this can be applied to any feedforward network classifier with localized first layer connections. Recognition results after denoising are significantly better over the standard DBN implementations for various sources of noise.

• Type: Conference
• Year: 2010
• Where: ICML
• Authors: Yichuan Tang, Chris Eliasmith
• Keywords: Hidden Layer Nodes, Hierarchical Generative Models, ICML 2010, Machine Learning, Probabilistic Denoising Algorithm