Exploiting local structure in Boltzmann machines

Restricted Boltzmann Machines (RBM) are well-studied generative models. For image data, however, standard RBMs are suboptimal, since they do not exploit the local nature of image statistics. We modify RBMs to focus on local structure by restricting visible-hidden interactions. We model longrange dependencies using direct or indirect lateral interaction between hidden variables. While learning in our model is much faster, it retains generative and discriminative properties of RBMs of similar complexity.

• Type: Journal
• Year: 2011
• Where: IJON
• Authors: Hannes Schulz, Andreas Müller 0004, Sven Behnke
• Keywords: Generative Models, IJON 2011, Indirect Lateral Interaction, RBMs