Robust sequential resource allocation in heterogeneous distributed systems with random compute node failures