Monte-Carlo optimizations for resource allocation problems in stochastic network systems

Real-world distributed systems and networks are often unreliable and subject to random failures of its components. Such a stochastic behavior affects adversely the complexity of optimization tasks performed routinely upon such systems. In this work we investigate Monte Carlo solutions for a class of two-stage optimization problems in stochastic networks in which the expected value of resources allocated before and after the occurence of stochastic failures needs to be optimized. The limitation of these problems is that their exact solutions are exponential in the number of unreliable network components: thus, exact methods do not scale-up well to large networks often seen in practice. We first show that Monte Carlo optimization methods can overcome the exponential bottleneck of exact methods. Next we support our theoretical findings on resource allocation experiments and show a very good scale-up potential of the methods on problems with large stochastic networks.

• Type: Conference
• Year: 2003
• Where: UAI
• Authors: Milos Hauskrecht, Tomás Singliar
• Keywords: Exact Methods, Monte Carlo, Stochastic Networks, UAI 2003, UAI 2008