The distributed spanning tree: a scalable interconnection topology for efficient and equitable traversal