Large-scale distributed storage for highly concurrent Mapreduce applications