Global Address Space, Non-Uniform Bandwidth: A Memory System Performance Characterization of Parallel Systems

Many parallel systems offer a simple view of memory: all storage cells are addresseduniformly. Despite a uniform view of the memory, the machines differsignificantly in theirmemory system performance (and may offer slightly different consistency models). Cached and local memory accesses are much faster than remote read accesses to data generated by another processor or remotewrite to data intentionally pushedto memories closeto another processor. The bandwidth from/to cache and local memory can bean order of magnitude(or more) higherthan the bandwidth to/from remote memory. The situation is further complicated by the heavy influence of the access pattern (i.e. the spatial locality of reference) on both the local and the remote memory system bandwidth. In these modern machines, a compiler for a parallel system is faced with a number of options to accomplish a data transfer most efficiently. The decision for the best option requires a cost benefit model, obtained in an empirically e...

• Type: Conference
• Year: 1997
• Where: HPCA
• Authors: Thomas Stricker, Thomas R. Gross
• Keywords: Cray T3D, Distributed And Parallel Computing, HPCA 1997, Local Memory, Remote Memory