A Scalable Parallel Algorithm for Self-Organizing Maps with Applications to Sparse Data Mining Problems

Abstract. We describe a scalable parallel implementation of the self organizing map (SOM) suitable for datamining applications involving clustering or segmentation against large data sets such as those encountered in the analysis of customer spending patterns. The parallel algorithm is based on the batch SOM formulation in which the neural weights are updated at the end of each pass over the training data. The underlying serial algorithm is enhanced to take advantage of the sparseness often encountered in these data sets. Analysis of a realistic test problem shows that the batch SOM algorithm captures key features observed using the conventional on-line algorithm, with comparable convergence rates. Performance measurements on an SP2 parallel computer are given for two retail data sets and a publicly available set of census data. These results demonstrate essentially linear speedup for the parallel batch SOM algorithm, using both a memory-contained sparse formulation as well as a separa...

• Type: Journal
• Year: 1999
• Where: DATAMINE
• Authors: Richard D. Lawrence, George S. Almasi, Holly E. Rushmeier
• Keywords: Batch Som, Batch Som Algorithm, Batch Som Formulation, DATAMINE 1999