Incrementally improving lookup latency in distributed hash table systems